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THE  EXTENDED  MULTI -ATTRIBUTE  DECISION  ANALYSIS  MODEL  (EMADAM) 


Capt.  Aaron  R.  DeWispelare* 

Abstract 

J 

This  research  is  an  on-going  effort  to  produce  an  interactive,  computer- 
based  aid  suitable  for  use  in  decision  situations  and  long-term  planning.  The 
current  research  involves  the  development  of  extensions  to  the  applicability 
of  a  decision  aid  embodied  in  the  computer  program  MADAM:  Multi -Attribute 
Decision  Analysis  Model.  The  theoretical  underpinnings  of  MADAM  involve 
portions  of  multi -attribute  utility  theory.  This  interactive  program  is 
designed  to  aid  the  decision-maker  in  all  phases  of  decision  analysis  from 
problem  formulation  to  sensitivity  analysis.  The  program  is  a  tool  designed  to 
be  used  by  a  decision-maker  in  order  to  facilitate  making  rational  and  con¬ 
sistent  trade-offs  and  subdecisions  throughout  the  entire  decision-making 
process.  The  stages  of  the  decision  analysis  covered  by  the  program  include 
formation  of  an  objectives  hierarchy,  elicitation  of  an  appropriate  set  of 
attributes,  examining  the  relationship  between  the  attributes,  establishing 
criterion  weights,  evaluating  candidate  solutions,  and  performing  several 
types  of  sensitivity  analysis. 

The  significant  changes  in  the  model  involve  the  stages  of  examining  the 
relationship  between  the  attributes  and  of  incorporating  probabilistic  data 
and  utility  concepts.  In  the  previous  version  of  MADAM,  the  program  guides 
the  decision-maker  in  determining  whether  or  not  the  condition  of  mutual 
preferential  independence  is  met.  This  determination  is  important  because 
the  previous  version  of  the  program  is  designed  to  handle  the  case  of  de¬ 
terministic  attributes  (measurable  value  analysis)  where  an  additive  value 
function  is  the  appropriate  overall  value  function.  The  exentsions  allow 
MADAM  to  be  utilized  for  the  case  of  probabilistic  attributes  (utility 
analysis) .  The  extended  program  aids  the  decision-maker  in  conducting 
lottery  trade-offs  so  that  independence  conditions  necessary  to  use  an  additive 
utility  function  can  be  ascertained.  The  utility  analysis  parallels  the 
former  value  analysis  in  structure.  MADAM  maintains  all  previous  capabilities 
for  sensitivity  analysis  as  well  as  the  new  utility  analysis  capabilities. 
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1.  Introduction 


Decision  situations  are  becoming  increasingly  complex  due  to  the  desire 
by  decision  makers  to  have  as  much  information  as  possible  with  which  to  resolve 
the  situation.  This  desire  for  increased  quantity  «nd  quality  information  has 
encouraged  analysts  to  attempt  to  quantify  previously  qualitatively  addressed 
concepts  and  to  utilize  increasingly  robust  models  to  store  realistically  describe 
the  world.  Because  of  complications  in  gaining  access  to  the  decision  maker  (DM), 
in  presenting  data,  and  in  interpreting  the  data,  a  very  thorough  analysis  may 
never  be  used  or  inefficiently  used  in  the  resolution  of  a  decision  situation 
(7,6,11).  It  is  hypothesized  that  it  would  be  beneficial  to  develop  tools  to 
help  the  DM  prioritize  salient  attributes  and  quantify  preferences  in  an  easily 
usable  format.  One  technological  boom  which  can  help  achieve  this  objective  is 
the  availability  of  inexpensive,  computationally  capable,  and  conveniently  small 
computers  (15).  These  computers  can  manage  and  display  data  pertinent  to  a 
decision  situation,  and  they  can  be  used  in  real-time  sessions  with  an  individual 
DM  tr  a  group  of  decision  makers. 

One  tool  which  has  been  developed  is  the  software  package  (MADAM,  16,  17).  Th 
computer  program  is  similar  to  other  interactive  decision  aids  which  attempt  to 
automate  value  (deterministic  utility)  structure  elicitation  from  the  DM  (4,10,15). 
The  program  MADAM  approaches  a  decision  situation  from  a  multiple  attribute 
value  theory  paradigm.  It  attempts  to  guide  an  analyst  and/or  DM  through  the 
steps  of  structuring  the  problem  in  terms  of  objectives  and  attributes,  quantifying 
the  DM's  preferences,  evaluating  candidate  solutions,  and  performing  sensitivity 
analysis  with  respect  to  the  preference  structure  and  alternative  realizations 
of  candidate  solutions.  The  current  capability  of  this  interactive  program  is 
conducting  a  value  elicitation  (deterministic  in  nature)  with  a  DM  concerning 
the  attributes  and  candidate  solutions  for  a  decision  situation,  and  allowing 
for  several  types  of  sensitivity  analyses. 


Among  applications  which  are  appropriate  for  utilizing  a  program  like 
MADAM  are  evaluation  of  competing  alternatives,  ranking  of  projects,  and  the 
testing  of  the  robustness  of  a  solution.  As  an  example,  the  government  could 
use  this  program  as  a  decision  aid  in  prioritizing  research  projects  within 
budgetary  constraints.  Annually,  there  are  a  certain  amount  of  funds  left  to 
the  discretion  of  government  laboratory  managers  for  dispersement  into  appropriate 
research  efforts.  The  universal  problem  that  these  DM’s  face  is  that  there  are 
apparently  more  deserving  projects  than  resources  to  adequately  fund  them. 
Government  DM's  could  use  the  decision  aid  MADAM  to  evaluate  these  projects  and 
resolve  their  dilemma.  A  major  deficiency  which  is  noted  in  using  programs  like 
MADAM  is  the  inability  to  account  (explicitly)  for  the  probability  of  achieving 
particular  attribute  levels  among  the  various  projects.  The  ability  to  incorporate 
risk  when  using  decision  support  software  would  expand  its  usefulness  because  of 
the  need  to  differentiate  among  alternatives  which  are  non-deterministic  in  nature. 

This  paper  describes  and  motivates  the  implementation  of  the  modifications  to 
the  computer  program  MADAM.  These  modifications  expand  the  capability  of  the 
computer  automated  decision  aid  by  allowing  for  the  incorporation  of  risk  and 
subsequent  utility  aspects  of  candidate  solutions.  The  incorporation  of  the 
DM's  attitude  toward  risk  in  a  Multiple  Attribute  Utility  Theory  (MAUT)  model  is 
discussed  in  Section  2.  The  actual  computer  program  modifications  developed  and 
then  implemented  in  code  (FORTRAN)  on  a  mainframe  computer  are  described  in 
Section  3  (See  also  Appendix  A).  The  modified  decision  aid  program  allows 
interactive  operation  and  contains  graphics  capability  for  rapid  feedback  to  the 
analyst  and  DM.  Section  4  (and  Appendix  B)  delineates  a  hypothetical  application 
of  this  decision  tool  which  concerns  the  prioritization  of  various  types  of 
government  research  projects  by  a  DM.  The  primary  aim  of  this  effort  is  to  expand 
the  capabilities  of  MADAM  to  explicitly  address  and  incorporate  elements  of  risk. 

The  second  aim  of  this  effort  is  to  illustrate  how  this  new  expanded  decision  aid 
may  be  applied  to  the  government  research  project  prioritization  problem. 
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MAUT  is  widely  used  in  decision  situations  which  involve  event  outcome 
uncertainty  (2,7,11,12,14).  These  events  have  associated  with  them  outcome 
probabilities  formed  from  either  empirical  data,  or  subjective  data  obtained 
from  expert  opinion.  The  objective  of  MAUT  is  to  find  a  scalar  scoring  function 
(SSF)  which  will  map  each  alternative  in  the  decision  situation  onto  the  real 
line,  and  in  the  process  form  a  complete  ordering  (ranking)  of  all  alternatives. 

For  the  case  which  involves  uncertainty,  the  objective  is  to  find  the  alternative 
which  maximises  the  expected  utility  of  the  DM.  For  the  discrete  cases,  this  is 
given  by 

Maximize  e(u)  ■  E  £  p . (a . )u(z .  . (a . ))  (1) 

•i  j  J  1  1J 

over  each  alternative  ai  where  E  is  the  expectation  operator,  p^  is  the  probability 
of  the  jth  event  outcome,  z„ .  The  SSF,  u,  is  a  utility  function  which  incorporates 
the  DM's  attitudes  toward  risk.  This  function  can  be  formed  by  combining  the 
salient  attributes  of  the  decision  situation  into  a  single  attribute  and  then  trans¬ 
forming  it  to  a  utility  function  incorporating  risk  (3),  or  by  use  of  decomposition 
techniques  which  form  constitutent  utility  functions  for  the  salient  attributes 
and  then  aggregating  these  into  a  scalar  function.  Many  authors  including  Keeney 
and  Raiffa  (11)  describe  assessment  procedures  for  this  latter  method  which  enable 
one  to  discern  the  mathematical  form  of  u  and  to  identify  scaling  parameters  based 
on  the  relationships  among  the  attributes.  This  latter  method  is  used  to  build  the 
models  described  in  Section  3.  The  alternative  policies,  events,  outcomes  and 
associated  probabilities  in  a  MAUT  formulation  can  usually  be  displayed  in  a  decision 
tree  format  such  as  the  simplified  single  state  tree  shown  in  Figure  1.  A  general 
algorithm  of  the  MAUT  process  is  shown  in  the  DELTA  chart  of  Figure  2. 

2.1  Computerized  MAUT 


Computers  have  the  potential  to  significantly  enhance  the  assessment  of  multiple 
attribute  utility  and  value  functions.  This  has  been  demonstrated  by  recpnf  research 
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Figure  1.  Single  Stage  Decision  Tree  Representation  Of  The  Decision  Situation 
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Figure  2.  DELTA  Chart  For  MAUT  Process  With  Uncertain  Outcomes 
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in  Che  case  of  a  single  decision  maker  (IQ)  and  also  in  Che  case  of  group  decision¬ 
making  (IS).  The  developmenC  of  Che  previous  compuCerized  assessmenC  packages  have 
fallen  shore  in  many  areas.  These  deficiencies  include:  1)  Che  failure  Co  incorporaCe 
Che  DM’s  aCCiCude  coward  risk  on  an  individual  aCCribuCe  basis;  2)  Che  lack  of 
a  sysCemacic  way  Co  incorporaCe  descripcions  of  Che  candidaCe  alcernacives  in  cerms 
of  sCochascically  based  raw  aCCribuCe  daca;  3)  Che  lack  of  immediace  feedback  Co 
Che  DM  of  Che  implicaCions  of  his  preferences;  4)  Che  lack  of  an  efficienc  procedure 
Co  updace  DM  preferences  and  conduce  sensicivicy  analysis.  The  compucer  program 
MADAM  originally  did  a  saCisfacCory  job  of  assessing  value  fi  _i«,ns  and  evaluaCing 
alcernacives  wich  decerminiscic  ouccomes.  It  did  noc  amelioi  -e  Che  firsc  Cwo 
previously  mencioned  deficiencies  concencraced  around  Che  la>  <  incorporation  of 
the  elements  of  uncertainty  in  a  decision  situation.  However  Che  structure  of  MADAM 
made  ic  attractive  to  modify  Che  program  by  adding  several  subroutines  which  allowed 
all  of  the  aforementioned  deficiencies  to  be  appropriately  addressed  and  resolved  in 
the  context  of  risk  and  utility.  Section  3  describes  the  specific  models  and  ) 

accompanying  procedures  which  are  implemented  in  structured  subroutines  on  the 
digital  computer. 


3.  Utility/Risk  Incorporation  Into  MADAM 
3.1  Previous  Capabilities  of  MADAM 

MADAM  was  designed  for  a  complex  decision  making  environment  which  exhibited 
characteristics  of  Type  I  and  Type  III  problems  of  Figure  3.  The  modifications  in 
this  effort  which  incorporated  utility  concepts  into  MADAM  are  intended  to  allow 
for  solutions  to  decision  problems  of  Type  II  and  IV.  Originally,  a  DM/analyst  was 
able  to  use  MADAM  to  conduct  interactively  a  problem  formulation  phase,  the  form¬ 
ation  of  an  appropriate  value  function,  and  a  sensitivity  analysis  phase.  The 
DELTA  chart  of  Figure  4  shows  the  program  flow  for  the  problem  formulation  phase  of 
MADAM.  In  the  problem  formulation  phase,  the  DM  is  guided  in  the  construction  of 
an  objectives  hierarchy  which  is  designed  to  define  issues  of  concern;  limit  the 
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Figure  3*  MAUT  Formulation  Typology 


problem  to  •  tractable  size,  and  identify  operational  variables  or  attributes. 
Additionally,  the  problem  formulation  phase  establishes  an  appropriate  range  of 
realization  levels  for  each  attribute,  and  characterizes  a  feasible  set  of 
candidate  solutions  or  alternatives  in  terms  of  these  attributes.  There  is  graphics 
capability  for  the  appropriate  timely  feedback  of  the  objectives  hierarchy  and 
attribute  set  to  the  DM. 

The  next  phase  of  MADAM  explores  relationships  among  the  attributes  in 
attempting  to  establish  mutual  preferential  independence  (MFI),  and  then  establishes 
constituent  scoring  or  value  functions  for  the  individual  attributes.  MADAM  uses 
the  weakened  sufficiency  conditions  (12)  of  pairwise  preferential  independence  (PPI) 
to  explore  the  existence  of  MPI.  MPI  among  attributes  is  both  necessary  and 
sufficient  for  justifying  use  of  the  additive  form  of  value  function. 

’(»)  •  J  wi  •  ’i  (2> 

where  V(x)  is  the  scalar  value  function,  v^(x^)  is  a  constituent  value  function 
of  an  individual  attribute  x^,  and  is  a  scaling  constant  reflecting  the 
relative  criterion  weight  of  attribute  x^  compared  to  the  other  attributes. 

Currently  MADAM  only  has  the  capability  of  utilizing  an  additive  form  of  V(x),  but 
caveats  are  issued  automatically  if  MPI  cannot  be  established  warning  the  DM/analyst 
of  possible  error  in  scoring  and  ranking  the  alternatives.  The  individual  value 
functions  are  next  established  using  the  midvalue  spliting  technique  (11).  Once 
the  individual  value  functions  are  established,  graphical  display  to  the  DM  of 
these  functions  is  used  to  verify  their  form.  Next  the  scaling  constants  or 
criterion  weights  are  elicited  using  the  ratio  technique  (5,13).  Now  all  parts 
of  the  SSF,  V(x),  are  present  for  evaluation  and  ranking  of  each  candidate  alternative. 
Figure  5  shows  a  DELTA  chart  of  the  value  function  establishment  pahse. 

Sensitivity  analysis  is  performed  in  the  next  and  last  phase  of  MADAM. 


Sensitivity  to  criterion  weight  changes  for  upper  level  nodes  and  attributes 
vdata  nodes)  for  all  alternatives  or  any  alternative  individually,  and  to 
attribute  levels  at  a  particular  node  for  each  alternative  explored  in  this  phase. 
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Figure  5«  Value  Function  Phase  of  MADAM 


There  is  a  graphical  presentation  of  the  resulting  alternative's  scores  due  to 
the  variation  of  parameters. 

In  all  three  phases,  only  deterministic  attribute  levels  for  the  alternatives 
are  permissible  as  input.  Also  no  attempt  is  made  to  incorporate  the  DM's  attitude 
toward  the  risk  involved  vith  each  alternative.  In  the  resulting  sections,  the 
modifications  to  MADAM  are  described  which  ameliorate  these  weaknesses. 

3.2  Modifications /Current  Capabilities  of  Extended  MADAM:  EMADAM 

The  incorporation  of  stochastic  data  for  alternatives  under  evaluation  and 
the  DM's  attitude  toward  this  risk  in  a  utility  function  was  accomplished  in  three 
steps;  (1)  model  and  implement  a  protocol  for  exploring  relationships  among 
attributes  in  terms  of  utility  concepts,  2)  model  the  incorporation  of  risk  into 
the  DM's  value  function  and  establishing  a  protocol  for  assessing  utility  functions 
accompanied  by  graphical  display  of  these  utility  functions,  3)  model  the 
combination  of  individual  utility  functions  into  a  global  utility  function  and 
then  provide  a  description  and  subsequent  evaluation  of  candidate  alternatives  in 
terms  of  the  risk  containing  utility  development  and  provide  for  the  inclusion  of 
probabilistic  attribute  data. 

Attribute  Relationships 

In  order  to  establish  a  mathematical  basis  for  using  a  specific  utility 
function  with  which  to  score  and  subsequently  rank  alternatives,  relationships 
among  the  attributes  must  be  examined  with  respect  to  both  the  DM's  preferences 
over  the  attributes  and  attitude  toward  risk.  A  manual  approach  for  checking  for 
Mutual  Utility  Independence  (MUI)  among  attributes  is  described  by  Keeney  and 
Raiffa  (11).  This  approach  using  PPI  and  utility  independence  (UI)  for  checking 
for  MUI  was  developed  into  an  algorithm  and  implemented  in  a  new  Subroutine  called 
UPI  (Appendix  A-3).  The  flow  in  UPI  is  shown  in  Figure  6. 

MUI  is  both  a  necessary  and  sufficient  condition  for  using  the  multiplicative 


form  of  utility  function  and  it  is  also  a  necessary  condition  for  using  the  additive 
form  of  utility  function  as  shown  in  Equation  3  below  (11): 


Figure  6.  Flow  of  Subroutine  UPI 
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where  u^(x^)  represents  «  constituent  utility  function,  ,  which  is  a  function 
of  «  single  attribute,  x^;  and  represents  the  criterion  weight  or  scaling 
constant  corresponding  to  u^(x^),  and  U  is  the  combined  utility  function  for  all 
attributes.  The  additive  form  of  U  is  used  in  this  effort  since  it  is  the  form 
that  applications  have  shown  to  be 'very  often  justified  (11).  Sufficient 
conditions  for  using  the  additive  form  of  U  are  the  establishment  of  Pishburn 
Marginality  but  these  conditions  can  be ..me  intractable  for  any  practical  application 
where  the  number  of  attributes  is  greater  than  two  (7,11).  Caveats  are  issued 
if  MUI  cannot  be  established  and  the  DM/analyst  is  given  the  choice  of  stopping 
the  analysis  or  continuing  with  the  knowledge  that  some  error  is  possible. 

Utility  Function  Assessment 

Because  MUI  is  either  established  or  assumed  in  subroutine  UPI,  individual 
utility  functions  can  be  established  as  functions  of  single  attributes.  The 
most  common  approach  for  incorporating  the  DM's  attitude  toward  risk  and  preference 
simultaneously  is  through  a  simple  lottery.  Figure  7  shows  the  construction  of 
a  simple  lottery  where  the  DM  is  asked  to  trade  a  chance  at  two  outcomes 
in  terms  of  a  single  attribute  for  a  minimum  amount  of  the  same  attribute  for 
certain.  This  amount  is  called  the  certainty  equivalent  of  the  lottery  (22). 

The  utility  of  this  certainty  equivalent  can  be  seen  to  be  equal  to  the  expected 
utility  of  the  lottery  which  is  calculated  using  Equation  1.  A  series  of 
questions  in  the  form  of  lotteries  can  define  a  utility  curve  for  a  single 
attribute.  In  the  assessment  process,  the  probabilities  are  held  constant,  and 
the  outcomes  are  varied.  A  series  of  questions  in  the  form  of  lotteries  can 
define  a  utility  curve  for  a  single  attribute.  In  the  assessment  process,  the 
probabilities  are  held  constant,  and  the  outcomes  are  varied.  While  there  may 
be  some  drawbacks  in  using  the  lottery  technique  (4),  it  is  by  far  the  most 
often  used  technique  for  assessing  a  DM's  utility  (2,11,12).  This  lottery 
technique  was  developed  into  an  algorithm  and  implemented  in  Subroutine  UTIL 
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Figure  7*  Simple  Lottery 


(Appendix  A 2). 

The  points  of  the  constituent  utility  curves  just  determined  are  curve 
fit  using  a  least  squares  criterion  for  five  forms  (exponential,  quadratic, 
linear,  logarithm,  and  square  root).  The  closest  fit  of  the  regression  attempts 
is  parameterized  for  ease  of  data  handling  for  all  utility  curves.  The  regression 
results  and  error  are  displayed  to  DM/analyst.  The  individual  utility  functions 
are  graphically  presented  for  the  DM/analyst.  This  visual  feedback  will  corroborate 
the  risk  averseness  characteristic  of  each  utility  curve  for  each  attribute  as 
a  consistency  check.  Subroutines  PICTUR  and  RDATT  were  modified  to  accomplish 
the  last  two  major  steps.  Figure  8  shows  the  flow  of  the  utility  function 


assessment . 
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Probabilistic  Data  Inclusion/Expected  Utility  Calculation 

The  strength  of  the  utility  theory  approach  to  decision  theory  is  the 
ability  to  take  into  account  the  realistic  risk  associated  with  levels  of 
the  attributes  (outcomes  occurring  in  the  future)  for  each  alternative.  In 
order  to  allow  for  ease  of  interfacing  with  the  digital  computer,  the  Subroutine 
RDV  (Appendix  A-4),  asks  the  analyst  to  input  discretized  or  spike  probability 
distribution  data  corresponding  to  levels  of  the  attributes.  A  maximum  of  ten 
discrete  probabilities  are  allowed  for  each  attribute  per  alternative.  Checks 
are  included  to  insure  that  these  discrete  probabilities  are  collectively 
exhaustive.  The  resulting  probability  distributions  are  displayed  graphically 
through  Subroutine  DRWPRB  (Appendix  A-6). 

The  expected  utility  for  each  attribute  for  each  alternative  is  now 
calculated  in  Function  CONVLT  (Appendix  A-5)  by  forming  the  linear  sum  shown 
in  Equation  1.  Constituent  utility  values  corresponding  to  the  discrete  attribute 
levels  just  entered  are  calculated  from  the  previously  determined  utility  curves. 
These  utility  values  are  multiplied  by  the  corresponding  probability  of  occurrence 
for  each  attribute.  The  resulting  expecting  utilities  for  each  attribute  are 
combined  with  the  previously  described  scaling  constants  to  produce  the  linear 
sum  of  Equation  3.  This  results  in  a  combined  utility  score  for  a  simple 
alternative.  The  flow  of  the  data  entry  and  utility  calculation  phases  are 
shown  in  Figure  9. 

This  process  is  repeated  for  each  alternative.  The  set  of  alternatives 
are  ranked  and  the  respective  combined  utility  scores  displayed. 

The  example  presented  in  Section  4  and  Appendix  B  demonstrates  the 
use  of  the  newly  enhanced  decision  aid  MADAM  for  a  problem  involving  probabilistic 
data  and  utility  concepts. 
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4.  Prioritizing  Research  Projects  -  An  Application  of  EMADAM 


4.1  Problem  Definition 

The  Department  of  Defense  (DOD)  philosophy  on  funding  initial  research  and 
development  (R  and  D)  programs  (also  called  "new  starts")  is  to  commence  efforts 
in  many  areas,  but  only  fund  the  advanced  development  and  eventual  procurement 
of  the  few  -  efforts  that  are  the  most  successful,  potentially  fruitful,  or 

vitally  needed  (18,19,20,21).  Many  government  laboratories  are  aooortionRH  a  certain 
amount  of  funds  to  start  new  R  and  D  projects.  Unfortunately  there  is  always 

insufficient  funding  to  cover  all  the  attractive  R  and  D  projects.  The  problems 
faced  annually  by  the  government  research  executives  are  how  to  rapidly  and 
appropriately  prioritize  the  new  R  and  D  efforts.  A  tool  like  EMADAM  allows 
the  DM  and  analyst  or  advisor  to  work  through  each  phase  of  the  prioritization 
in  an  informed  and  timely  manner.  This  allows  for  not  only  a  ranking  of  the 
projects,  but  also  a  more  thorough  understanding  of  the  process  by  the  parties 
involved. 

To  serve  as  an  example  of  a  possible  use  of  EMADAM,  a  hypothetical  application 
concerning  R  and  D  project  prioritization  is  now  presented.  Appendix  B  gives 
an  interactive  listing  of  this  application  of  the  research  project  prioritization. 

4 .2  Attributes 

An  objectives  hierarchy  was  established  for  this  decision  situation  (Appendices 
B  and  D).  The  measures  of  attainment  of  the  lowest  level  objectives  are  the 
attributes  for  this  problem.  Four  attributes  were  identified  as  salient  in  this 
decision  situation.  They  are  (1)  technology  base,  (2)  sponsorship  potential, 

(3)  cost,  and  (4)  time  to  project  fruition. 

The  "technology  base"  attribute  addresses  the  issue  of  being  able  to 
successfully  produce  a  solution  for  identified  needs  as  opposed  to  just  expanding 
the  technological  base  in  an  area.  The  end  objective  of  each  R  and  D  project 
is  evaluated  as  to  the  existing  technological  base  as  well  as  estimated  difficulty 
in  achieving  the  end  objective.  A  ten  point  scale  is  used  to  rate  each  project 


(Appendix  C)  from  Che  extremes  of  no  Cechnology  base  and  excreme  difficulty  in 
achieving  research  objective  to  simply  a  new  use  of  existing  well  developed 
technology  with  little  difficulty  in  achieving  end  objective.  Each  project 
is  rated  based  on  an  extensive  literature  search  of  existing  technological 
bases  and  expert  opinion  with  respect  to  difficulty  in  meeting  the  research 
objective  within  five  years.  In  all  cases  where  expert  opinion  is  used  to  refine 
attribute  levels,  a  Delpi  exercise  is  used  to  achieve  concensus  (13).  There  is 
some  uncertainty  associated  with  the  estimates  of  the  technology  base  obtained 
from  expert  opinion. 

The  "sponsorship  potential"  attribute  is  aimed  at  ascertaining  the  number 
of  potential  major  organizations  which  will  commit  funds  toward  advanced  development 
and  pre-production  testing.  This  attribute  is  used  as  the  primary  indicator  of 
the  importance  of  the  deficiency  or  need  addressed  by  a  project.  Zero  through 
five  major  organizations  is  the  range  of  this  attribute.  Surveys  with  the 
potentially  interested  major  organizations  are  the  primary  source  of  data  for 
this  attribute  for  each  project.  Because  some  organizations  withhold  their 
commitment  of  funds  until  some  future  point  in  time,  there  is  some  uncertainty 
as  to  the  exact  number  of  sponsoring  organizations. 

The  attribute  of  cost  seems  to  be  the  most  straight  forward  attribute  but 
modifications  of  the  yearly  costs  must  be  made  to  establish  a  common  time  basis 
for  the  research  projects.  All  research  budgets  are  made  on  a  five  year  planning 
cycle  as  dictated  by  Congress.  Because  projects  are  generally  funded  for  all 
five  years  once  they  are  started,  this  period  is  used  as  the  absolute  maximum 
time  allowed  for  each  project  to  reach  the  identified  research  objective. 

Therefore,  each  project  is  budgeted  so  that  the  research  objective  can  be 
achieved  in  five  years.  The  highest  cost  project  is  used  as  the  basis  or  standard 
and  all  other  projects  are  allotted  the  same  annual  amount.  This  step  resolves 
the  arbitrary  nature  of  funding  and  puts  all  projects  on  the  same  effective- 
budget  schedule.  The  fact  that  many  projects  would  be  accelerate,  and  produce 


'Its  faster  than  usual  at  the  basis  funding  level  allows  project  differentiation 
in  che  next  attribute  to  be  discussed,  which  is  "time  to  project  fruition."  This 
equalizing  of  the  proposed  annual  budgets  for  the  projects  allows  the  attribute 
"cost"  to  be  dropped  from  analysis  so  as  not  to  double  count  its  effect.  This 
reduces  the  number  of  attributes,  and  makes  the  decision  situation  more  tractable 
in  quantitative  terms. 

The  "time  to  fruition"  attribute  indicates  the  actual  time  (less  than  or 
equal  to  five  years)  for  the  R  and  D  project  to  produce  significant  results 
(i.e.  achieve  the  research  objective).  Because  many  projects  will  take  less  than 
five  years  to  produce  significant  results  at  the  equalized  effective  basis  funding 
level  discussed  earlier,  the  combination  of  this  attribute  and  cost  will  differentiate 
among  the  alternatives.  Expert  opinion  and  past  research  efforts  are  used  to 
produce  the  estimates  of  time  to  fruition  for  each  project.  As  with  the  other 
attributes,  risk  is  involved  in  this  estimate  and  therefore  a  distribution  is 
appropriate  for  describing  the  attribute  level  achieved. 

4.3  Alternatives 

Five  generic  R  and  D  projects  were  ranked  in  this  effort.  While  these 
projects  were  hypothetical,  they  are  very  similar  in  characteristics  to  actual 
projects.  These  projects  S,  T,  X,  Y,  and  Z  are  described  in  terms  of  attribute 
data  in  Appendix  B.  Project  S  has  the  characteristics  of  an  expected  general 
project  with  low  to  average  technology  base  (TB),  a  reasonable  number  of 
sponsors  and  an  average  time  to  successful  results.  Project  T  would  be  called 
an  average  development  oriented  project  with  a  high  TB,  a  few  sponsors,  and  an 
average  expected  time  to  successful  development.  Project  X  is  the  high  risk 
alternative  with  a  low  TB,  only  one  sponsor,  and  a  long  expected  time  to 
fruition.  Project  Y  has  the  characteristics  of  a  typical  research  oriented 
project  with  a  low  to  average  TB,  small  number  of  sponsors  and  a  long  lead 
time  to  successful  results.  The  final  alternative,  Project  Z,  is  often  called  t 

a  "sure  bet"  because  it  has  characteristics  that  almost  always  assure  success 
in  an  average  amount  of  time  such  as  a  high  TB  and  many  sponsors.  The  specific 


21 


attribute  values  and  accompanying  probability  distributions  are  shown  in  Appendix  B. 

4 .4  Results 

A  government  DM  familiar  with  the  R  and  D  funds  allocation  problem  was 
used  in  this  effort  to  add  realism  to  this  example.  The  objectives  hierarchy, 
attributes,  criterion  weights  (scaling  constants),  relationships  among  the  attributes 
and  individual  utility  functions  were  all  established  by  the  DM  in  realistic  sessions 
utilizing  EMADAM.  Appendix  B  contains  an  abbreviated  but  representative  listing 
of  the  output  for  this  example. 

The  DM  established  the  objectives  hierarchy  (Appendix  D)  which  led  to  the 
attributes  discussed  earlier  and  listed  in  Appendix  B.  The  DM  was  able  to  establish 
MUI  among  the  attributes  which  are  necessary  conditions  justifying  use  of  individual 
utility  functions  of  individual  attributes,  and  the  additive  form  of  SSF  (Appendix  B) 
The  individual  utility  functions  were  elicited  from  the  DM  (Appendix  B),  and  as 
expected  all  indicate  an  aversion  toward  risk  with  respect  to  all  attributes.  The 
utility  functions  for  "time  to  fruition"  and  "number  of  sponsors"  displayed  the 
most  risk  aversion.  The  criterion  weights  established  by  the  DM  indicate  the 
"number  of  sponsors"  willing  to  support  development  (an  indication  of  need,  •  50) 
is  almost  twice  as  important  as  either  "time  to  fruition"  (W^  ■  30)  and  TB 
(W^  *  20)  in  prioritizing  alternative  projects  (Appendix  B).  Of  course  these 
weights  (scaling  constants)  may  only  be  valid  for  the  ranges  of  the  attributes 
considered  (11). 

The  calculated  expected  utilities  for  the  five  projects  (Appendix  B)  are 
as  follows:  U  (Project  S)  -  64.20,  U  (Project  T)  *  64.68,  U  (Project  X)  -  27.15, 

U  (Project  TO  •  53.74,  U  (Project  Z)  =  65.01.  On  a  100  point  normalized  scale, 
some  significant  differences  are  evident.  Project  Z  clearly  dominates  Projects 
X  and  Y,  but  outdistances  Projects  S  and  T  by  only  1Z.  The  usefulness  of  a 
quantitative  decision  aid  such  as  EMADAM  is  not  only  in  the  absolute  ranking  of 
the  alternatives,  but  also  in  the  relative  differences  between  alternative 
project  scores.  While  not  a  specific  objective  of  this  effort,  extensive 


22 


sensitivity  analysis  is  available  with  EMADAM  as  an  aid  to  the  DM,  and  for  this 
example  clearly  needed  to  differentiate  projects  S,  T,  and  Z. 

4.5  Computer  Utilization  Summary 

A  listing  of  the  routines  developed  in  this  effort  (ASKU,  UTIL,  UPI,  DRWPBR, 
CONVLT,  and  RDV)  is  provided  in  Appendix  A.  These  routines  are  written  in  FORTRAN  V 
and  all  graphics  capability  is  compatible  with  any  common  alpha-numeric  terminal. 

In  addition  to  the  routines  coded,  many  other  subroutines  in  MADAM  were  modified 
to  allow  compatibility  of  both  deterministic  and  probabilistic  data.  The  subroutines 
modified  were  ATT,  ASET,  ATTSET,  PICTUR,  and  RDATT.  The  enhanced  version  of  MADAM 
(i.e.  EMADAM)  is  now  in  excess  of  5,6000  lines  of  code.  EMADAM  is  segmented  in 
overlays  which  at  no  time  take  more  than  S6,6000  bytes  of  memory.  This  reasonable 
memory  requirement  due  to  overlaying  allows  for  interactive  execution  of  the  program. 
The  CPU  execution  time  is  nominal  for  a  reasonable  size  problem.  This  example 
problem  took  less  than  six  seconds  total.  This  example  was  performed  on  a  CYBER  175 
(CDC)  system. 

The  interactive  terminal  time  totaled  approximately  three  hours  for  this 
sample.  This  time  was  accomplished  with  the  DM  in  two  sessions.  The  DM  expressed 
satisfaction  with  the  usability  and  commented  on  the  ease  of  understanding  the 
prompts  provided  by  the  enhanced  MADAM  program.  The  length  of  time  required  by 
the  DM/analyst  does  not  seem  excessive  when  one  considers  the  number  of  steps 
accomplished  in  the  decision  resolution  paradigm. 

5.  Summary,  Conclusions,  and  Recommendations 

5.1  Summary 

In  this  effort,  several  modifications  to  the  decision  analysis  software 

tool  MADAM  (16,17)  were  accomplished.  These  modifications  enhance  this  decision  making 
aid  by  incorporating  utility  concepts  and  probabilistic  data  into  the  analysis 

process.  The  DM/analyst  can  still  accomplish  the  setting  of  objectives  and 


determination  of  attributes  (Figure  4),  and  now  has  the  choice  and  capability 


of  using  an  automated  tool  for  exploring  relationships  among  attributes,  assess 
Che  DM's  value  or  utility  functions,  and  include  attribute  data  for  either  the 
probabilistic  or  deterministic  data  case  (Figures  5,  6,  8,  and  9).  Several 
computer  codes  were  developed  to  implement  the  modifications  accomplished  here. 

These  modifications  are  summarized  in  the  following  tasks: 

1.  model  and  code  a  protocol  for  examining  utility  and  preference  relationships 

among  attributes  (Subroutine  UPI,  Appendix  A-3); 

2.  model  and  code  a  protocol  for  the  incorporation  of  risk  into  the  DM's  value 
function  and  assess  his/her  utility  functions  along  with  graphical  display  of 
these  curves  (Subroutines  ASKU  and  UTIL,  Appendices  A-l  and  A-2); 

3.  model  and  code  the  inclusion  of  probabilistic  attribute  data  for  the  alternatives 
along  with  graphical  presentation  of  this  data,  the  combination  of  individual 
utility  functions  into  a  global  utility  function  employing  an  expected  utility 
calcualtion,  and  the  subsequent  evaluation  of  the  utility  for  each  alternative 
(Subroutines  RDV  and  DRWPRB,  and  Function  CONVLT,  Appendices  A-4,  A-6,  and  A-5). 

5.2  Conclusions 

Conclusions  to  be  drawn  from  this  effort: 

-  The  enhanced  version  of  MADAM  (EMADAM)  can  effectively  incorporate  probabilistic 
data  for  the  attributes  of  alternative  systems  under  evaluation,  and  utility 
concepts  (additive  form  of  utility  function)  into  a  decision  analysis. 

-  This  type  of  decision  aiding  software  tool  is  appropriate  to  project  evaluations 
and  selection  problems  such  as  the  allocation  of  government  research  and  development 
funds  as  demonstrated  by  the  example  in  Section  4  and  Appendix  B. 

-  The  usability  of  EMADAM  appears  acceptable  as  demonstrated  on  a  moderately  sized 
problem  (Section  4,  Appendix  B).  A  DM,  with  or  without  an  analyst  can  execute 

a  decision  analysis  with  EMADAM  due  to  the  interactive  set  of  prompts  presented 
by  the  software. 

-  The  enhanced  version  of  EMADAM  is  efficient  in  terms  of  computer  memory  required 
(less  than  57K  bytes  due  to  over-laying),  and  in  terms  of  CPU  execution  time 

(less  than  six  seconds)  for  a  moderately  sized  problem  (Section  4,  Appendix  B). 


The  convenience  of  interactive  operation  is  somewhat  offset  by  the  required 
terminal  time  for  the  OM/analyst  (approximately  three  hours  for  the  example  problem 
delineated  in  Section  4,  Appendix  B). 

5.3  Recommendat ions 

Two  recommendations  are  offered  in  response  to  this  effort  First,  expand 
EMADAM  to  accommodate  other  forms  of  global  utility  functions  besides  the 
additive  form.  The  multiplicative  form  (11)  would  be  a  tractible  function 
which  incorporates  non-linearites  in  a  decision  situation.  Second,  develop  a  more 
sophisticated  procedure  to  assess  the  scaling  constants  (criterion  weights). 

Such  a  procedure  should  allow  for  more  consistency  checks  without  inducing 
obfuscation  (5,11). 
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Appendix  A 

Computer  Code  Enhancements  To  MADAM 


**  Appendix 

3ub-  outim:  asku( : *xi *x2 »xh:d > 


th is  ?:ut:\e  asks  the  QUESTicr»s  uh:ch 

OA  ”  A  =>cIN’3  FrCM  WHICH  THE  ESTIMATE!) 
LTILI'Y  FUNCTION  HAY  3E  EST  ABL 1 3HE0. 


CALLED  9Y:  U’lL 
V A ° I  AD LEc 

U3ED:  XI  ,X2  »XH  ax  .X*'I*. 

•edified:  vh  id 


:a 

CH  a  -  i  c  T  ” 5  a  ^  ~  l  *  l  . 


A-l  ** 

025450 
025460 
025470 
C  25  A  - C 

*****»*<.»*»»*t**»***t*t*M««  0 25 4° 0 

*  025*G0 

*  C 2551 0 

ELICIT  '!'HE  *  025520 

SDI VI  DUAL  *  025530 

025540 

*  0  2  c  5  5  0 

*  02556C 

*  0255T0 

*  0255a  0 

*  0255°0 

*  025600 

*  C25610 

*  02*623 

*  C2563C 

*  0?5f 4C 

. . .  C 25650 

025660 

02567C 

02c6cn 

325690 


o=  -  -  .  ,  •  «  025  7C" 

P- W  ,HA*  L  l  V  C  t_  IF  A '  7S :  gL’TE  ’tAT'lC)  C2c7i: 

f-  :.*».*  w:  “h  cc;'a:'*y  w:uld  rru  t  =  a  de  f:=  a  lctte5**  025',2c 

n:  ;  A  5  -5  '  OA.CZ  .F  *  C"  I  V I  %  5  El  THE  ‘  '  02573-T 

H-- :  . - *.f2*«  .:•*  l-'T"*:  .f  att  =  :bute  • « at*  i < i >  oz57<*r 

C2C"50 

AT  (  •«  '  (F  :  .  •  )  •  )Xv:  •*  "2t76* 

x  4 : ,  =  a  « :  \  i  ( x :  ♦  x  i )  025773 

X‘M<  -4 VAX’  (A  .  ♦>:  )  3  2  5  7  -'' 

IF  (<  X  •:"*.L’.X'*  X’l  D.C-  *.  X"AX  ))  TMf  n  2  5  7 ' 0 

?  -  -  •  * « #  r  *• :  7 .  *  "l*':qf  the  -a  -,e  .f  %>!.’  to  *  txr  P2C  -or 

c  •  ■  1  0  2 c  •  1 : 


**  Appendix  A- 2  ** 


SU-»=  0'JTI  NE  l  "IL 

0270" C 

,4T\ 

02T10C 

02  71 1 0 

02  T 1 2C 

*  * 

0271 30 

* 

• 

027140 

• 

♦ 

027150 

S 

THIS  ROUTINE  GENERATES  THE  DATA  POINTS  FR  CM  WHICH  THE 

• 

C271E0 

s 

INDIVIDUAL  utility  functions  a=e  estimated*  and  calls 

027170 

$ 

ROUTINE  REG33  TC  DC  THE  E3tIMA’ICN. 

* 

02  71 P  0 

• 

• 

0271°C 

* 

• 

0272CC 

$ 

CALLED  9y:  LFI.FDAT' 

• 

027210 

* 

• 

027220 

• 

VAU  ABLES 

* 

C  2  72  30 

* 

USED:  NATTtXHIO 

• 

C2'*24C 

• 

* 

02^250 

modified:  ch*i,val*x 

• 

0272E0 

• 

• 

C27270 

• 

0272°  C 

0272^0 

02‘7300 

027310 

CO  v«  TN/ATTR/NATT 

02732C 

c:  yv  :n/val^val<e  ) 

027330 

3A  V£ 

C  2  7  34  0 

a- 

CHA- ACTE=  CH»AT*l*i: 

027350 

* 

PRIN’*«»  » 

0273F0 

PS  I".  '  •  ,  *  • 

02737C 

P=1D*.»  T  HE  'J  T I  L 1  T  Y  FUNCTIONS  F  Cc  EACH  ATTPIBUTr* 

0273>='' 

PAIN’-*'  WILL  fCW  BE  DETERMINED  * 

0  2  7  3C  C 

PR  I  ,  *  *  ,  •  * 

C  2'’  4  C  0 

*  • 

02 ”41  0 

n:  i  :  :  - 1 »  n a ■  ■ 

C  2' 4  20 

1 

CAL.  A3<U(I.ATT(I,2)tAT-(I,3)*X''ID> 

0  2  7  4  3  C 

VAL<  I  >  =  ATT  C  *2) 

02  74 4 ^ 

VAL(  5)  -  ATT  (;  ,?) 

027450 

VA  L  <  3  )  =  X  M I  D 

0274F  C 

X=  X  :  D 

02",47C 

cal,  a:x j( : * att( : *: ) .x,<^:oi 

C'2  74j'' 

VAL( 2  )  =  X  MI D 

0274-? 

call  a:.x,j(I*at*<:*7»,val(3),x«i?» 

32753? 

valc  ns^iD 

C275  I! 

CAL-  SET  *  i  < : > 

C  2  7  5  2  C 

r' "  7  <  *•  *  * 

0 2  7 E  3? 

p3:'.t*.»*he  a r r v e  yield:  a  l:il:~y  function  p?3  •*at*i<i> 

0  2  54  ? 

C  5  ;  :  •  .  *  w:  --  F Af  A  vE'r  E-  0  :  • 

0  2  7551* 

PC  :*  ,c«-  ,]  ),*  H1=**?A  AY(;,.-5> 

0  2  7  5  -;  ? 

?s  :.*«,•  iu •*  r  *■  oja'  ed  -  :=  =  *  »pa ;  a-* ( :  * 7 > 

0  2  7  5  7  0 

:c  (;  \  a  .r  r 

0  2  7*  j 

c" :  i  * « . » <  l  :  r  A'  fc*  m  » 

*  2  -  *  “  n 

*  «,  ’  J*  :  ♦"  •  (A  r  7  7  .  L'  T  E  LEVEL)* 

c  2 '  f.  c : 

4 

r  l  ::  a  a  id. -1.  >  * u e  , 

r  2  E  1 7 

% 

;  iL  A:  r-  C-.  '  F  *  >  * 

02’620 

- L  .  '  »  i  *  _  T  !  •_  '  *  Y  ■=  ,-i  1  ♦  <  •  (  A  *  T  -  I  v  ,j-T  *  L  E  v  r  L  )  *  ♦ e .  r  *  0276  3" 


else: :f(^a=av(i ,4>.eq.i  .c  >-he\ 

PR  r  <  ’  *«  •  CS  DL'APEO  Ft.-  M)  • 

P9  *NJ  T»  *  •  'JT  IL  I  TY  =  9£  *0  1  *  (A  TTRI  BUTE  LE VEL  >  *  *2 .0  • 

ELSE  :F<»AR  AMCI  »4>.E3.-2.C  )THE*« 

PR  IN  ~  •  »  •  (  L  3  G  AP  IThHIC  FC=*>» 

PR  IN  T*  «*  util:  TY=0C*81  *L\'(  ATT  FI  BUTE  LEVEL*  * 

EL  SE  IF  <  OAR  A  «(  I  ,4*.  EQ.  2.0  *’ HEN 
PR  IN;*,  *  (EXPONENTIAL  FC'  M*  • 

PR I 1  ’*# • UTIL  IT Y=BC *8 l *EXP( ATTRIBUTE  LEVEL*  * 

£'■  01  F 

CALL  PICTURfl* 

2  P3:d*t»  * 

PR  I'i  T  *»•  DC  EC  THE  ABOVE  " EPRE SENT A” I C \  APPEAR  RE  A  C-GNABLr  ?  (Y/M» 
?• 

EAO ( •» •  (Al)  •)  CH 

IF  ((  CH.  ,£.  »Y  ♦  *  .  ANO.  (  CH.NE*  »fi  •  »*~  Ht\ 

P3I‘i"*.»Y3U  *U$T  ENTER  "r"  OR  ■%•• 

RJ  '  J  2 

end:  f 

:f (ch.eo.  »n»  jgo  'c  i 

10 — COTiT  ;  7TJE  '  '  -  — 

PET'J  =  N 
EVD 


02',feAC 

32765C 

C27Sf  0 

0276TC 

0  2  76c  0 

0276=0 

327700 

027710 

027720 

027730 

027740 

327750 

027760 

0277^0 

0  2  7  7  0 

0277-  3 

O27SO0 

027010 

327320 

0273J0 

C278  40 

027P50 

0  27Q  60 


**  Appendix  A-3  ** 


Sul  1  lU^TIE  L'P  I 


?  2^-70 
C  2  T5  ’  0 
0  2  7  p  '  0 
-*C27^o: 
02  7~ 10 
027*20 
*02  7~3C 
*027340 

*027=5  i 
•02  73s: 
*027=7? 

*027=53 

•  0  2  7acC 
*C2-  OC"1 
•0  2  0  1C 
•02“ 020 
*0  2“ 0  30 

0  2  0  *0 
*C  2  -  3 E  0 
*32:060 

•  3  2  0  0  7  0 

*  C  2  :  G  c  C 

*  3  2-’  C  =  0 
02  1C 
3  2  -■  1  1C 

c  2  - 1 : 
fl2  it; 

-  -  *  “  ■  M 


THi:  'I'jri'.E  cr  CUC”  s  a  test  ;f  *utual  UTILITY  INOEPENOENCE  by 
C'VD'JCTIM  TESTS  'f  PAIRWISE  P  -  EFE  3  E*. r  I  AL  AND  I  V  DE°E"DENCE  FCJ 
A  SEL'CTEO  AT7SI8UTE  WITH  ASPECT  T  3  THE  CPhE3  ATT  R I  BUT  ES  • 


CALLED  BY:  ROAT 


variable: 

u :  d  : 


'  q  :  f  : :  r : 


AT"  ’  1  t  A’  --3  2. 1  AND.  CM  f  01  tCELl  *  I  « 
:'.oe--*c:l,  j.k»*'ax:  .MAyz.MiM 
'E^Pt-ENFl  »rE*F:  f  r-:LEc*'CTHE~ 


.  .  - "  /  \  *  -  ■ 
■  ■  t '/ 


*r‘  ■  *  A 


.  t  -  -  r  -  t  L  1 


a-3 


►  -4  *-l 


3 EA  L  8A\D (2  *2 ) « VAX1  • M I M  , HA X2  , “ I  M2 
I  N  ’  E  G  E  -  AL 
F  (  ,  A"  r  .LE  .1  >CALL  l!T  H 
F < i ATT .LE.2  )GC  ”G  1 . o 
*  I  ND  ER  c  =  0 

per  •.?  ,  ,  t  « 

PF.I\T***AT  WHAT  TOLERANCE  oc  you  want  tc  CHECK  YCU3* 

PRI  ; 7*  *  * R ES F  ONSE  •  •  USER  ,*  (PLUS  0R  MINUS  X  PER  CENT ) ?• 

PRINT***  X  =  ?* 

5EAD(*,*(  12  )  •  )  I  "CL 
TO LER=FLOATCTtE)/l  30. C 

PRlNT-t’UE  ARE  WORKING  AT  PLUS  CR  MINUS  •»ITOL«*  OERCEN"* 

9  P°: NT*, USE? *•  WHICH  ATTRIBUTE  OG  YOU  WISH  TO  EXPLORE  THE* 

P3INT***UTILITY  INDEPENDENCE  OF?  (IF  YC  U  WISH  TO  REVIEW* 

PRI NT*  *  *  THE  ATT  3 1 BU  TES  IN  THE  0°  DER  THEY  WE°E  INPUT** 

P3I NT*, 'ENTER  1CCC,  OTHERWISE  ENTER  THE  ATTRIBUTE  NUMBER  NOW.)* 
®EAD(*«*(IM*>r.AU 
I  F(  NA'J.NE.IGC  0  60  TC  11 
PR  I N " *  » •  • 

print*. 'attribute  numbe-* 

00  10  :=1,NATT 
P  «I  N” *  *  *  ' 

°“I  :.T  *  *  AT  T1  ( I  )  *  *  *,I 

0  CONTINUE  '  -----  -  . 

.1  IF<  '  AU.GT.'.ATTIGC  t  c  S  ' 

AT?  -»l  =AT7l<  '  AU) 

MAX1  =  AMAX1(ATT(\AU»2)*A'’T(.'  AU,2>  > 

MIM=AMI  N1(ATT(NAU*2  )  *  AT  T  <  MAI.  ,3)) 

DEL1  =  (3AX1-*IM>/13 
DO  2  0  Jr  1  »',  AT" 

IFf  J.EO.NAOGC  '0  l’ 

AT“r.2  =  AT'l(  J) 

MAX2  =  A  •AXl(ATT(j,2)  ,aT- <J,3)) 
m:*.3  =  A'*:  X1C  ATT(  J#2  )  tAT*  (  J*3  )  > 
de^2-c^ax2-v:n2)/i.: 

=  ':  r«,*  » 

P=:  <T** • SUPPOSE  THA'  THE  FOLLOWING* 
p- I '  T*  ♦  *Ar"*  IBUTES  A3E  AT  THESt  LEVELS:* 

DO 3:  K  =  1,'ATT 

: Ft ( k. : o. na D . : -. ( < .t o. j) >g :  to  zr 
T  C-T  HE  r:4T’l  (K  » 

TE'''0:((AT~(K*3)-At"  (K,2))*»25*A*7  ( K  *  2  )  ) 

PrI  "!T  *  »  T  J  7"  r-  »  »  =  *  Zvz 

c  :\  t:  \-.-r 

_?_“I  .  T  »,*  r  HA  AT  "HE  P_ERCiM  LEVEL* 

3C  ..:*.*  • 

’  -V'-l  =  YA<1- :  .  I  «  OE  L 1 

oi  =  te  •*:>i • :  :i  ec 

TE  ,32=vAX2-v.:«0EL2 

p  nt* «  »  jtw  suDr  v h a "  y;u  have  the  im  'Ial  cnND:Tio''  : : • 

=  •:  <7* ,  a*- •  ’-pi  , »  a  c  •»  at~.  2»*  =  »  *tvp2 

p  •  • 

:-2r-r  *c;.0EL;*2. 

p3:  .r*,  * ;  >4ag: \e  *  h  a  *  *.at%:**  is  changed  t:  •*,'e*'p2 

?iI  .T*,*V-»A"  LEVEL  F  •  ,  AT"  l,*  *r  UL  D  Kt  EP  AS  SATISFIED* 

3  =  :  "*«m:  y : l  we--"  u\c:‘  -he  :  :*:al  c'\di~:"n"?* 

3  < '  :-evBl  5  ’-.a*  ill  .  t-ie  a'"-:blte-:  a3-,  a** 

h;  :  -  "  e :  c  •. T  ._e  jf  l  > ' 


C  2t163 
:2-i  ■»: 

c  2 1 1  > o 

C2f 1«0 
0  2=  200 
0  2 l'  2 1  C 
C2r  22 r 
C2R23C 
02*  2A3 
02- 25C 
02'  260 
0  2  0 270 
029280 
C  2  0  29  0 
02  3  30C 
02^310 
C  2  2  20 
02" 33C 
0293A0 
0  2  3  350 
0  2 :  360 
029370 
C  2° IP" 
0  2  9  3C  0 
02= AOC 
C  2C  M  0 
C  2  = A2C 
02  A 3 3 
02  A*0 
C 2  *5C 
02  AfcC 
■3  29  A  7  C 
0  2  0  A  -  0 
C2= Ac c 

: 2*50  c 

02?51C 
C29523 
02- E2C 
02-5AC 
C  2l  59  3 
02-56" 

0  2  "  5  7  C 
02-5=0 

PJC-C" 

C2'6C" 
02  61  0 
02  :  62 0 
C  2  6  ?C 
3  2-  pa: 
C2- 650 
C  2  66  " 
02*67' 

C  2  :  f  - ■  1 
0  2  '•  6  =  ' 

C  2  70  ' 

0  2  71  0 
0  2  72' 

C  2  7  3r 


n  . 


,£AD(*»,(Fi:«C),»r_wPl 

IF(  (TEMPl.L'.HI?  1  >.  IR  .(  *EMP1.6T  .MAXI  )  >  THE?« 

Ps:nT*.'T«E  IS® IT  LEVEL  OF  **TE wPl 

PRINT*. *IS  CUTSIOE  THE  GIVE'.  RANGE  OF  •  ,A7T<I  ,2  )  »•  TO  *  *  AT”  <  1  ♦  3  ) 
GO  *0  1 
EM  IF 

8AOCl»l)='EMPl-Dl 
BA‘4  0<  1.2>=*EYP1  -01 
T  ENP1 =  MAXl-5.0  *0EL1 
TEMP2  =  v'A'<  2-c.  0  *DEL2 

dc;v.,'  » 

PR  I N  T  *  *■  *  SUpc  ?S  E  *  H  AT  YOU  ARE  STARTING  A' • 

oo  :  <  :*  .A’T31  f  •  =  •  .TE*°1  •  •  ANO  •  *  A’TR2  ♦  •  =  *  ♦,’E«F2 

p=:n'*,*  • 

TE  •,a  E  =  *  E  “P  2^  T  •  C  *  DEI  2 

°®:  <’*.*I'*ag:..e  that  *,rEHP2*»  :s  *.attr2«*  is  achieved.* 

PRINT*, «T0  w^AT  LEVEL  yOULD  YOU  CHANGE  *.ATTP1,*  IN  ORDER  'C* 

°P 1 1 T*. • REGAIN  Al  SATISFIED  AS  YCU  JE  RE  INITIALLY?* 

PR  I  < '*  .  *  <REPE*BEr  that  all  other  attributes  ARE  AT  'HE* 

PRI<T**»25  PERCENT  LEVEL)* 
pr  :*i-.f*  ?• 

PEAK**  •  (FiO  .2  >•  )TEWP1 

IF  ((  T£H°1.LT  .HIM  ).02.(TEMol.GT  .MAXI  )  )  THEN 
°° IS r *, *  THE  I NPUT  LEVEL  OF  *frE^Pl 

PRl4r**'I3  OUTSIDE  TuE  GIVEN  RANGE  OF  *,ATT(!,2)»*  TO  **AT'C!*3> 

GO  •  ;  2 
£'  3*  r 

BA’ J (2.1 >='EVP1*D1  . 

BA  rO  <  2. 2  >  =  'EWC  1-01 

FR I . 7* .USER . • .  SUPPOSE  MOW  THAT  THE  FCLLIUI'G  ATTRIBUTES* 

PR:  T.fM3£  SHIF'EO  T  j  '  hE  SE  LEVELS :  * 

O  K  -  1  *  N A 

IF  (  (<.f  3. NAD  .0  '  .(K.EQ.J)  )GC  TO  A" 

'S‘-'E3=a:'i(k> 

TEvp=((A7TCK,3)-ATT<<.2))*.7E*A:'<K*2)) 

03  t*  ,  *  t'he  -  ♦  »=  * . 'rE*p 
CGf.r :  nue 

=3 IN T • » * 7HA~  IS  AT  THE  7z  PERCENT  LEVEL* 

33  I  ';*••»  * 

~E  '*  I  =HA< 1 -3 .0  *OEH 
'E  I  -  MA  V2  .  0  »OIL2 
=>?  IN  *  *.  ’SUP^'SE  'HA'  Y  C  'J  HAVE* 

=A  I  J'*  .  A*'  R  I  .  .7E*«31  .  »  AND  *»A'-?2.*=  *."E“P2 

3?  *  •  -  *  ,  »  f 

'E  °  :  =  '  E*3  2-3.  C*CEL  2 

®R  ;.'•** :mag  :ne  *ha'  r  he  level  of  *,a t*p; 

33  -  .'*.*:'  C-ANGED  7  '  ♦.'E'*®  _'»*•* 

-R  IN ’*♦  *  .:uLC  -“E  LEVEL  *F  »,A*”;:1**  fF'DED  to  3E“AI'.* 

==:.:*, m:  :at:.f:fo  as  a'  the  initial  conditions* 

=  j i  . ■ * , 'l: e  oe'jee:  •  »ha  .ki  »:> .  •  am  »,hano(i.2> 

-3  :  ■  r . ,  •  ( r/  )  ?  • 

-e  a:  ( *.  •  (a: )  •  >c- 

r<(CH.  -  .  #T  »).a*  2.(Ch.’ 


02' 740 
02- 75C 
0  2  3 760 
029770 
0  2  a  7°  0 
0  2“  7C  0 
029c  00 
02FF  10 
92FF2C 
029a39 
02RC  40 
3  2c  ?  50 
029  0  60 
025- 70 
0298  3  C 
0  2 5  8- 0 
028c00 
026510 
025=20 
023530 
023540 
0  269*0 
0  28c  60 
02  5C  7C 
0  2  °  ~  8  0 
02E  9°  0 
C  2 ' 0  0  0 
C2~0 10 
0 2" 0  20 
02*030 
0  2®  0  40 
02=050 
02=060 
0  2C0 70 
C  2C03O 
02=090 
GZ'100 
02=110 
02=120 
32’ 130 
02  140 
02=150 
02  160 
C  2  1  t  0 
n  ? o  i 
0  2° l *  0 
C  2 ‘ 20  C 
02*210 
cc  i  2  2  0 

::*2?g 
0  2  <*  2  *  0 
r  p  c  c  s  o 


:  .  '  *  ,  •  .  .wY 


.  '  A  L  L  *  *  I O  .  *  ♦  L  I E  = 


:f  (c-i.eo.  *n*  >:NOEer  =: 

fz  :  i  «,  •  • 

7E**PI  =  MAX1-5.0*DFL  1 
TE  ^  2=MAX2-5  .C  *DEL2 

PR  IN  7  *  »  *  SUPP  C  S  E  'HA'  YCU  HAVE  THE  IMTAL  CONDITIONS:* 
P=!:‘;T«  •AT’-Fl  I  AND  •  ,  A7TP.2  *  •  =  »  ,TEHP2 

PRI\**»*  • 

TEMP2=TEMP2«>3.C*DEL2 

prin t*,*imag:ne  -HAT  YCU  MUST  ACCEPT* 

P»INT*,*A  LEVEL  CF  *,7£MP2,*  IN  * ♦ AT  TR  2 
PRTNT*, ’WOULD  THE  LEVEL  CF  *,ATTP1 

PR  IN  T*«  *  THAT  YOU  WOULD  HAVE  TC  M ;  VE  TO  CIN  CD  DER  TO  BE  AS* 
PRIN T*»*3A71  SFIED  AS  UNDER  THE  IMTAL  CONDITIONS)  LIE* 

PP IN  7*, 'BETWEEN  • , BA  NO (2 « 1 ) * •  AND  *tBANDC2*2) 

PRIN-*,  *  CY/N)  ?* 

PE  AD  <  *  ,  » ( A1  )  •  )CH 

IF((CH.*E**Y*).AND-(CH.NE.*N*))-HEN 

OR  IN r*,USER« *»  YCU  MUST  ENTER  ■ Y ■  OR  *N" * 

GO  T  0  4 
E*  DI  F 

IF (CH.EQ.*N* )INDEPP=1 
1FC  .OE’R.EQ  ,0  >'HEN 

pR  I  N  T  •  ,  *  T  H  Er  E  A=E  NO  INDEPENDENCE  PF  C  BL  EMS  • 

Ps:\T.,»uITH  THE  AT  T  I  BUTE  5  T£GtEO  SO  FA-,* 

P°  I N  T  *  t  *  DO  YOU  WISH  TC  A'SUM£  MPI  FOR  THE* 
os  IN T* , •REGAINING  ATTRI8UT£S?  <*/N>* 

pr  •  ?• 

-E AD ( *,  • ( A1 ) * )Ch 

IF  <( CH.NE. »N*  > .A?  D.C Ch.NC. *Y • ) >tm£N 

P=  !'iT*t»?LEA:E  F  *  TE  R  *Y*  CP 
GO  ■  0  5 

e  ;o:  f 

IF (C H.E1. *\* )'HEf 


pr  :  • 


IP  YCU  O'  V'T  WISH  *0  ASSUME* 
AMCC  G  the  A7T°ISUTE'.» 


pp IN »DS  YCU  UA' 


f -OF  «UI  - £CT I NG?  (Y/\>.» 


rEA)(*,’(Al)*)Cu 

IF((CH.  .E.  »■  •).A'0.(CH..E.*Y*))7HE\ 

=? :  -  * ,  ,3lea*e  E‘Tr-  "y"  or  ■<•.* 
go  ■  :  s 
c  n:  f 

E‘  Cl  F 

:p  <c i.  *y»  is:  -o  - 

EL  E 

c:  -  A-  E  r.DEPE'  DE’.CE  F-*  CBLlmS  » 

pc  :.*♦,*  a  *  ;u  ■  g  rri:  a ‘tc  :  <ute  *  a.-'Eaoy  tecto.* 
P-*  :  *,  »o;  v;u  WISH  0  *  o3  *ui  "El-ING?  Cy/n)* 


-  EAS (  •  »  *  ( A. >  * ) C- 

IF  (C  CH.  M.  *  '  >  .  A  C.  (  CH  *v  »  ))  -  he* 

is:  '*.,3lea~e  e  ■  t  e  -  "  y"  :=  ■■,■* 


:  f  < :  h  .  l  ; . 


C2C 310 
02  320 
02 ' 330 
C2C  3 A C 
0  2C  350 
0  2C  360 
92- 37C 
0  2  R  3C  0 
0  2°  3°0 
02',40C 
02  410 
C  2r-  A20 
0  2C  A  30 
02'’ AAO 
02=450 
02c  AGO 
0  2°  A70 
C2‘ 4=0 
0294°0 
02=500 
C2‘  510 
C  2^520 
0  2  n*  5  3  0 
0  2' 5A0 
02G55C 
02<-56C 
C2  =  57C 
C  2c5r  C 
0295SC 
02=600 
C2CG 1C 

02c62r 

02" 63C 
C  2C  6 A  0 
0  2'- 650 
02°  66C 
02  670 
0  2Q6'-  0 
02  *6=0 
02  700 
02' 710 


C2S  7  : 
02=7°: 
p  2  ~  c  r  n 

:  2 '  f  i  : 
02=62" 
C  2  c  p  3  v 
r  2  ~  S  <*  ‘ 
' 2r 65' 

C  2  “  F  6 1 

02cc  7" 


IF  ( I  NDE0  R  .EQ.C  J'wEN 

PR  FIT*,  ’SINCE  •  »  ATT  1  C  NAU  >  «  •  13  PAIRWISE  PREFE3ENTI  ALLY* 

PRIN T*, ’INDEPENDENT  OF  THE  C  T  HER  ATTRIBUTES,  ATTRIBUTE  * 

PRI\ T*,ATTit \AU> »• WILL  N  9W  OE  TESTED  FCP  UTILITY  INDEPENDENCE*  • 
EN  01  F 

IF  (I  \0EB  R*  ME -0  )  T*-  EN 

PRINT*,  •  THE0  E  APE  INDEPENDENCE  P-OBLEMS* 

PRINT*,  «AMOU.\G  THE  ATTRIBUTES  (HPI  DOES* 

pp:nt*,»not  hcld).  do  you  wish  ~o* 

PRIN’*» ’CONTINUE  THE  ANALYSIS  WITH  AN* 
op  IN **, ’ADDITIVE  UTILITY  FUNCTION?  (Y/N)* 
fp I j  ’»,  «  ?• 

*  EA3 ( *♦  ’  ( A  I  >  *  )  CH 

IF (C H.E3. • Y* )CALL  UtIL 

end:  F 

Ar  T3  I  =  AT  71  <*  AU  I 

MAXI  =  AHA XI (ATT<NAU,2  )  *ATTCNAU,3> ) 

VI  Nl  =  A  M I  N1  (ATT  (  N  A  U  *  2  )  »AT’(NAU»3)  > 

deli  =(haxi-«:ni)/ic.: 

FRINr*,»  • 

PRINT*, ’WITH  THE  OTHER  ATTRIBUTES  EXCEPT  *,A7’R1 
PR  :r*,  •  SET  AS  the. FOLLOWING  LEVELS’ 

PPIN~*,«  • 

DO  SO  K=i,NATT 

IF (K .EG. NAU) GO  rC  60 
TO  THER  =  AT-1(K) 

TE'-'Ps  <  A”<<,  3>-A~T<K  ,2  >  >*.2E*ATT  (K  ,2  ) 

PR  IN’*,T  jTHE-,  •  =  *,’E  *P 
Cl  N" INUE 

TEHP  =(  A*  T  {<,2>-A7r  (<  ,2))  *.25*ATT  CK  ,2  ) 

-r«p  i  =  HAXl-5,0  *OEL  1 
D1  E  MP  I  *  7  CL  ER 
OR  I  N  *  «  ,  •  ’ 

PR  I  *;  *•  ,  ’  NOW  WHAT  VALUE  IF  AT  rR  I3LTE  •  ,  A  T  TR 1  ,  ♦  W  I T  =  CERTAINTY* 
pp  IN' T  *, 'WOULD  YOU  T?a0E  FOR  A  LITTERY  OF  A  50-51  CHANCE  'OF* 

PR  I  NT*, ’DECEIVING  E I r  HEh  *,MAXl,*  UNITS  C  =  *,MIN1,»  UNI’S  OF’ 

PR  IN  r«, 'ATT-  IBUTE  ’,AT’R1 
PR  IN'*,'  ?• 

E AD (• , • (FI  1 *C >  •  > TE  ’PC 

OF  ((  *E*.=  I.  L'  .MI*  :  )  .  0  -  «  (TEMPl.Gr.*AXI  )  )ThEN 

p°int*,  the  ' n p u t  level  of  *,'emci 

PR  I  I  S  ..UTSIPE  T  -s£  -ANGE  OF  *  ,  AT  T  C I  ,  2  )  *  •  TC  •,AT"C,3) 


E  o:  F 

”r  VO  »  ~  •  £  .4  0  2 

BA  ‘.  1  <  1  ,1  )=': 

It  A  ‘  J  C  ,  I  )  =  •  E  F 1  -  D I 

os :  - . , '  i 

p 5 :  »'*,*'. i w  -hat  value  if  attribute  »,a’ 

P-  'U'_p  V'L  ~:^DE  F  ?-  A  L  '  "  T  E  -  Y  CF 

p=  :.**,'  -:cl: vi- N  e:  •  her  *,v ax:,«  lnits 

=  5  I  -*  ,  »  AT  OBU’E  »  •  A  ”  3  1 

PR  I '  *  •  ,  ’  ?  » 

•  E  A  o  c  *  ,  •  C  F  :  . 

*f  (( 


Rl.’WI’H  CE=TAI 
A  50-5 ■:  CMAVCE 
F  ’.TE'^P3,*  UM 


*.Tv* 

■*  F  • 

’S  IF* 


0296*  0 
0296=0 
029900 
02  ?= 10 
029=20 
q2ot«q 
029940 
029=50 
029=60 
929=79 
029=90 
0  29  =  =  9 
03000* 
0  30010 
C  3C020 
030030 
039040 
0300EC 
9  300  60 
0300  70 
030990 
0390=0 
0  30 1 9  3 
039110 
039120 
030139 
932140 
030150 
030160 
0391 7C 
,  0301=0 
0321=0 
C392C0 
C3I2  10 
020220 
039230 
0392*0 
0  3 9 25 C 
0392=0 
0  30  2"'0 
0  2  9  2"  0 
C  2  ■*  29  0 
030390 
9  2 1  3  1 0 

1  103  2n 
930330 
C  30  34  2 

C 29 3*9 
9  3r  3=  0 
93*279 
?  3  A  3  3  9 
r  t  <■  if  • 

2  3  o  *  0  ' 

:  •"•*1 : 

9  3  '  a  2  9 


>  *  )  ’  E  J  '  3 

"E  2  )  .  '  (  "E  VP  3  •  G  '  •  v  AM  1  )  )  ”  -E  N 


g 


'  J  E2 
:  f 

’e»°;.  =  tewp3 
BA NO (2. i >  =  ’E  **p 1*D1 
9A"  3(2.2)  =  TtMPl-01 
print*,*  » 

f° I VT.t ,  * ALJJC- -flf—AjT 5 I BUTX  !a  atjtr i  ,  »w: Th  certainty* 
PRINT*, »yOULO  YCU  7 R ADE  FOB  A  LOTTERY  OF  A  EC-53  CHANCE  CF* 

PR  I N  T* , ‘RECEIVING  EITHER  *»TEMP2,*  UMTS  C°  UNITS  OF  * 

PC  TiT*, ‘ATTRIBUTE  • «  ATTR1 
PRINT*,*  ?• 

CEAD (* , • (F1C .0 )» )TEM04 

IF  ((  “E“°4.  LT  .HIM  )  .C=  .  (TEMP4  ,GT.TEYD2  )  >~HEN 
Pc INT*,*THE  INPUT  LEVEL  OF  *,"EKP4 

°PINT*,‘IS  CUTSIDE  THE  RANGE  CF  * ,  HI  M  ,  •  TC  *,“EMP2 
GO  ’  I  c3 
ENOI  c 

TE  MO  1  =  "  EMP  4 

BAND ( 3» 1 )=  "E  MP 1  *D1 

BA?-iD(3,2)=TE*'Pl-01 

pp  I  n  r  * ,  •  • 

PR INT*,U3E°,*t  SUPPOSE  NCy  THAT  the  FOLLOWING  ATTRIBUTES* 
PRINT*,*A°E  SHIFTED  TC  THESE  LEVELS:* 

PR  I N  ”  *  ,  *  * 

DO  70  k=i,natt 
IF  («.E1..NA'J>GO  T  C  70 
TGTHER  =  AT"’1(K) 

TE“P  =  (  ATT<<, 3)-AT“(K  ,2)  )*.7E*ATT  (k  ,2  ) 

PR  I  *  i  T  * , T 3THE‘ , •  =  » ,TEMP 
CONTINUE 

PR  I*’ T*  ,  *THAt  IS  AT  THE  70  PE  CEN  *  LEVEL* 

FMN  *«  »  » 

c=  I’-  "  *,  *M  V  FOR  “HE  LOTTERY  ZF  a  EC-50  CHANCE  CF  RECEIVING  E I  THE 

pr  :nt**'*axi,«  units  *»’*:\i,*  units  of  attribute  *,at“ri 

cRIN“*, ’UOULO  YCU  TRADE  F0  =  A  VALUE  CF  ATTRIBUTE  *»ATTR;,» 
p-  :n’*,«CER’AINTy  BETWEEN  *  ♦  BAND  (1  ,1  )  ,  *  UMTS  AND  *  .  BAND  ( 1 , 2  > 

PR  :\“*,»UMTS,  (  Y  /  N  )  ?  « 

' EAD( * , • ( A1 ) * ) CH 

IF ( C  CH.  ,E. »Y * ) . A  D. ( CH.nE. *N  »  ) ) th[  , 

PR  I N  *  *  »  *  ON L  Y  ■  Y*  Of  IS  ALLOi*  £0,  *,USCR 

g;  '  73 

E‘  0:  F 

IF  CH.I  J.  »N*  )  I  NDEct-sl 
CR  I  .  ‘ *  • 

in  * *» ‘ now  f;-  '«e  mt“e  =  y  r?  a  ^ —  5 n  chance  of  deceiving  e:tme: 

03  IN  *•  ,  -«AX1  ,  •  v*  I  T  Z  •  ,TE«*“2,*  U*  I”S  CF  AT*=  IBUTE  »,AT'R1 

p=  4’  UN  c  Y'\  T=AOE  F?3  a  VALUE  ~F  ATTCI8UTE  *,ATtR:,»  WITH* 

c:.  *  •  '  •»  ’CEt-AINTY  BE 'WEE'  *  ,  1  A*  0  <  2  ,.L  )  ,  *  UM“S  AND  *,BA*.D(2,2) 

■=- :  ’* »  *ijm*  (y/ n  » • 

EAD ( • , * (A  I ) * ) Cu 

IF  C(  CH.  '  C. *  *  *  > .  A  L  D.  (CH.  L  l.*N  »  n  ’HEL 

:  :  ■*, »  j'.ly  "y*  >:  =  :o  allowed,  mum3 
go  *  '  7 « 

E*  c:  f 

IFCCi.E-3.  •  .*  >  I  ML-  :  =  • 


c  3i 4c  : 
0  T  r  a  o  0 

C  3C  4  tc 
C  30  4: 0 
0304°: 
G  3CE0  1 
03*510 
03C52G 
0  30 E 30 
C  30 E 4  t 
0  3C5E0 
030*60 
0  3C  57C 
0  3C5  =  0 
0  30  E°  0 
030000 
030610 
C3C620 
C3C631 
0  3C640 
C30F 50 
0  30660 
035670 
0  3  0  6 :  C 
U  3  n  6  0 
0 30  TOC 
031710 
U 2n721 
0  3  0  7  3  C 
l!  30740 
0  3  0  7  5  n 
0  30  760 
'03177' 
1317=  0 
0  30  7-=  0 
0  3CF00 
0  3 1 0 1  0 
1  3  ?  2  n 
C  2  0  p  3  0 
0706  41 

c?c ic: 
c  3  C  0  6  0 
03C  =  7: 

0  7  0  ?  •  0 
*031  =  ?' 

P  3  ]  C  n  ■> 

c  3  o « : : 
c  3 

C  3  "  ~  3  C 
13 ' ~  ; 

■  *  -  a  =  - 

C  7° -  7- 


□  3 


^  t  i  **  r 
j  .  *  «  » 

*n:  _  * r  ~ r '  y  .f  a  c.:-Zj  chance  cr  rmmvt.g  e:“he  *:,!ii: 


A-8 


A.',  -  ^ 


v  v' 


PR  I’i  T»yTZ*PZ  ,  »  UMTS  Ort  Si:  d,'  UMTS  CF  A  7T  -  IBU  T  E,  *  *  AT  '  R  1 
P9  I'l ’,*  ,  *WI  TH  CERTAINTY  BETWEEN  «  ,BANO(2  »1  )  ,*  l'MTS  ANO  *»BA‘ 
PR  I  NT *,  'UNITS.  (Y/N)» 

=  EAO  (*  *  *  (  Al)  •  >CH 

IF (C  CH.  .E. *Y  •) .ANO.CCH.NE. *N  *>  )7h£N 

pa.  IN  ’  *  ,  '  ONLY  ■  Y"  OR  m\m-  13  ALLOWED*  *,USER 

00  ”0  75 

E‘i  01  F 

:f(ch,eq.*n* i i noer  - = i 

IF  (!  NOE53 .EQ  .C  )THEN 
dr  i  -i :  * .  ♦  • 

PRIM***  » 

PRINT’*,  »  *hE  ATTRIBUTED  A=E  UTILITY  I  NOE  PENDENT  • 

ORIN'*,*  * 
p° :  n  "  *  *  *  • 

CALL  UTIL 
EL  -  E 

PR  i  N  r  * ,  *  THE"  £  A-E  INOEPEN  OENCE  p  =  CHLEMS* 

PR  IN  T*»  •  AMONG  THE  AT  ”  R  I  B'JT  E3  (*Ul  DOES* 

PR  IN  "* ,  •  NOT  HOLD).  OC  YOU  WISH  ' Q» 

PR  I  N  7  *  »  *  C3  NT  I NUE  THE  ANALYSIS  WIrH  A.N  • 

PRINT***AOOITIVE  UTILITY  FUNCTION?  (Y/T>* 

PRINT*.*  ?# 

c  E A3  <  *  *  * (Al) *>CH 

IF  (C’H.EO.  *  Y  *  )CALL  UTIL 

E\  31  F 

-ETJ-N 

END 


03102" 
0(3,2)031030 
0  310*0 
031050 
031060 
031070 
031050 
0  31050 
0M10C 
031110 
C  3 1 1 20 
031130 
C  3 1 1  *  0 
3  3 1 1 5  0 
031160 
031170 
0311M 
0  311P0 
0312C0 
031010 
031220 
C31233 
0312*0 
03125C 
C31 260 
031270 
0  31  2^0 
0  31  2  "0 


**  Appendix  A-4  ** 


"UH-‘:UT  :  ’. £~ -  ru 


0  35  35  3 
0  3°  3*"  0 
C3'  *00 
0  3C  *1 0 
03" *20 
0  3" *30 
0  3C  *  *  0 
0 I°*5 J 
0  3" *6  0 
0  3"  *  7  0 
r 3C  *5 0 
030*00 
C lc  50  0 
03=510 
0  3  5  c  2  0 
03=530 
02=5*0 

j  ^  -  5  5  1 
n  v-SM 


This  MUTINE  ELICI'S  The  A'TPIrSUTE  LEVELS  IF  THE 

alter.  ATivr  syittm?  ac’dss  all  ’■he  data  nodes. 


CALLED  BY:  WVLOOl 
V  A  - 1  AO  * 

used:  if  I*  :,f  i*  t,  my:-,  sjc'v 

■* :  d  : c  1 5 n :  j  n  :  w  '=  » : .  i : ,  j  ,  v a  x  ,  y m  i  n 


c  •  j •  •  / \  ■  ■  /  J” 
r  ■  ./  ••  •  * '  ,  •  .  <  ,  i 


(  ’  )  .  '  F  ’  C  . '  ?IFK.:cADO«L'/l  <1  *"  V  F  •  (  2  ,  3  > 


3  610 


ccw-i:n/,.ex/^cc‘'«:cata,:"C’l 
ct  vm  :  •!  / ;  r  ■:  i  /  •  e  y  : 

SA  VC 

CH  A’  AC  T E  F  *  1 '  LAHf  L  *  7  t?JCT  V(  16  >  «  i  Y  C  L  BL  ♦  AT  '  i 
P  9  I  -J  T • » • UE  A '  £  A'  THE  DA'  A  NCDE:* 

CALL  3BJECT  (  :F:f.D*C9  JCTV  ) 

II  =1 

00  5  1=1*4 

W9ITE(**MlX*4Ai:>*>  (C8JCTV(  K  >VK=II*::«3> 
ii  =:  :*4 

5  continue 

PR  T*  »  «Wh:CH  HAS  the  ASSOCIATED  ATTRIBUTE  *«LABEL(IFr*0> 

oo  i :  i=i*nsys 

DO  ‘3  3  J=1»\ATT 

if(labe'l<if:'  d)-eo.atti  <  jni  he\ 

PC  HE  C  K  =  A  T  T  (  J  *  1  ) 

30  T  :  31 
E'J  01  F 

i  cor;-:NUE 

IF (3 CHECK.EQ  .r .0 )THE% 

pr:^t**«  • 

PRI'JT*  #* -he  CUPbENt  LEVEL  OF  THE  ATTRIBUTE  •  *LABEL  ( I  FI'.D  ) 

PR  I  '4  T  *  *  •  I  S  •  *XLEVEL<  VRAY  (IF!  \0*  I  >  «  LABEL  C IFINO)  )  *  *  FOR  SYSTEM* 

DR  I  \  T*  *  S  YS  LBL  (  I  ) 
pr  • 

c°:;r**»THE  cA‘.GE  CF  the  ATTRIBUTE  IS  •♦ATTtJ.O)*1  TO  **AT"(J,3> 
xm:\=a«!\: <a*t(j*2>*  at* (j*3> > 

_XVAX  =AWAY1  (A^T  (U.2  >.  A~~<J*3)) 

OR  I  ;■*■*»  *  » 

OR  r.T*,  »whA"  is  THf  •  ry  LEVEL  (-PAL  ‘‘UM0E':  )  ?* 

R  E  A  J  (  *  *  '(FU  .4)«>AL5«E3 

IF  ((  A  \  3  W  E  3  •  L  ~  •  X  N I  *. )  •  SR  •(  Af.2WEc  •  G  •  Xw AX  )  )  T  HE* 
fP’  T  * »  •  THE  LEVr  L  CF  'fA’SWE3**  IS  *UT  IF  -ALG,'.» 

c-c  :  i 
E’ d:  f 
el  :  £ 

DEL7A=AHS<ATT(Jt:)-a-(Jt3))/i;.' 

m:  =  i :  *  ( i  -l  >  *4 

X=A*I  41( ATT( J»Z) .A"' <J*3>> 

ru  ,j!=  : . : 

: \ de  *= *i :  4-1 

tv  3 :  <  = '  *  * 

Y-  v*  DEL'  A 

:*.dex=:  o e x ♦  i 

p®  •  • 

RR  "HE  CL'R=  S  T  :?:<£  P 7 _ BAB  I L I " Y  (CEE  » 

CR  :  .  ■  *♦  'USE'-  •  *C  VA?U’AL)  FC-:  '  «LA'5lL(  IF!’  0) 

F=I'  A  LEVEL  'F  * *  \  *  *  lo  • . ATT ( J, I » DE X ) 

=  -;:•»»*  • 

OR  I T  *  *  *  A  H  A*  TS  *  he  ,Ey  :?IKS  R  .BAHILI’Y* 

o  : .  •  * « •  ? » 

e  a :<.,«(  f  :  .  4  j  • )  r  - .  ; 

IF (( R-  -  H. OR . ( RR  I  B.G". i .  )  )  ■ 4 EL 
c  ■  'HE  1  ’  Pl.’T  V  A  i_  J  E  F  »,RI^U 

,  ?= :  *•,»:;  utsi-t  :t.sr  f  (;.;*i.>» 
r=  i  .  *  * .  *  ~v_;a  .  e  -  l  c  '  I  3  7 '  "HE  cut  it;  *n* 


C  3  °  6  2  C 
C  2P  £ 3  C 
0  3cE4C 
03'  650 
03=660 
03=670 
0  396° 0 
C3°f°0 
0  3C 7C0 
0  3C710 
0  3°720 
039730 
C  3C740 
0  3C  750 
03=760 
0  3C  7  70 
0  3P7P.0 
C  3C  7=  0 
03-  eoc 
03=810 
0  3C82  0 
030830 
03°84  0 

02re50 
03=e6C 
C2C  870 
C  2P6  ^  £i 
C  3CP ~  0 
0  3?°C  C 
03F91C 
0  3  ?  c  2  r 
220=3; 
0  3C~ 40 
0  3C  *  50 
039=60 
C  39r 7 C 
0  2  5  ~  8  0 
0399=0 
04 ::c? 
C4C01C 
0  4  0  C  2  0 
C4?C  31 
C  4nC*C 
C*C0cC 
3*0 C 60 

c  «s  c  7r 

0  4  H  0  •  o 

04:ccc 

n*ric~ 

1*nll0 

o  4 :  l : : 
C  *  “  1  2  1 
C*4C 

04S1S'' 
C4c  l*'* 
0  4  r  1  *» " 


A-10 


'  .  ■ 


»  Ti  , 


GC  T  )  2 
esc:  f 

SU'4-  SUM*°?  0 8 

IF  C  C  >U*.GT  .1  .02) .OF .  (  (K. EQ.9 ) .AND. (3U*. IT . .  =  ? ) )  )  THEN 
PRINT*.*  • 

P9HT*.*TH£  INPUT  SPIKE  PROBABILITIES  DC  SOT* 

PF  :\T*  #  *  3U*  TO  l.Ct  TH£Y  SUM  TC  f*S’JM 
PR IN T*  ,  * 3EINPUT  THE  IPIKE  PR 3 9 AS  I L I T I E S • 

go  ' :  n 

ESCIF 

CALL  ATTWAL<  J*  rS‘CEX«PfiC9) 

CC  NT  I  YJE 

CALL  3RWe<>8(  J.MTN  tL  ABEL(  IF!1  0)  ) 

answer  =c  :nvlmj.m:n,labe  l<if  i' o> ) 

GC  I  5 1 

V  Cl  F 

A*:  3«£-.  =  VALU<  AN  SUE P  .L  ABEL  <  IF!  N  0 )  ) 

IF  ((  A  JSWER  .L'  .O.C  ).0P.  (A‘.SUE=  .6T*1  .:  )  >THEN 
ASSWEF  =  A«*:m  (AM WES  ,1.1  ) 

AN3WE RsA'MXl < ANSWER  *  '.2 ) 

pr:NT*,»ME  INPUT  ATTRIBUTE  LEVEL  CAUSES* 

Po  H  r  #  »  r  he  VALUE  GENEPA'-ED  <  9A3  ED  CN  THE* 

P=  IN  T*»*EjT: MATEO  INDIVIDUAL  VALLE  FUNCTION)* 
=R:*7*,*TO  BE  CU7SIDE  THE  1  AN GE  CC.J  -  1.0).* 
PRIN'*«*IN  C =  OEF  TC  “ E  P A I N  IN  THE  P?CPEP  RANGE.* 

P-J  1",  T  «.  »T  )'JF  INFLT  VALLE  IS  BET  G  CHANGED  TC* 

==  '*  ,VLE  VELCAf  SUE?  .  L  ABEL  ( I  F  INO  )  ) 

P?:.-*»*:f  r H I S  IS  UNACCEPTABLE.  USE  *.*ATT**.« 
PPIVr*.*'-:  AO  JUS  ”  THE  value  FUNCTION.  AF"  e~  * 
p*  ih*«*«exitt:».g  th;  :•  cft:cs.» 

ENDI  F 

CA  LL  VS.-I~<  IFINC.I  .  ASSWES  )  _  _ 

CO  N”  I  >» UE 
P»  IN'*.*  * 

P?  I N  ”  *  #  *  ENTE  5  C:-«ENTS  0*  THESE  ENVIES.* 

CA CSETCIFIND) 

=  I  T  J  •  N 


CA01P0 
C  AO  190 
0  A0200 
0  AO  2 10 
0  AO  2  20 
0*0230 
0  AO  2 A  0 
0*02*0 
0  AO  260 
0*0270 
0*0 2s  0 
0  AO  2® 0 
0*0300 
0  AO  7 10 
0*0320 
0  AO  330 
0*02*0 
0*0350 
0  AC  360 
0*0270 
0  *0  3p  0 
0*0390 
0*0*00 
0  A  C  A  1 0 
0*0*29 
C  AC  *  30 
0 ACAAO 
0  A  C  *50 
C  *  C  460 
C  AC  A70 
0*C ABC 
0  AC  *90^ 
0  *0  50  (T 
0*CC10 
04Cc2C 
0  AC  5  30 
0  AO  c AO 
0  AO  550 


**  Appendix  A-5  ** 

F'J.-.C'IIN  CCWL'C  J.MIN  ,A’  5  I B  ) 

CM A=  ACTE  <  •  1 "  A~" -  IB 

i  .0:  <- *. 

CEL'  A  =  AAS<A'*<J.<  )-A"'(J.3))/lS. 
r~  *.«'  i.*:  •  ,* 

x= a  > ;  i f  a_t( j. : » ,a T' ( j»  * ) ) 

0'  L  •  : :  .  • 

v  =  v. JEu’A 
I',::/:'  .  CEX*  ! 

c  -  J  =•;  ;  .  VL**’/Ai.u  (<  .AT*-  IB)  •  AT"  (  J  .*  •  9E  *  > 

c:  n'  :  i 

.  c  - 

"  3 


C  3  7"  2  0 
0  37530 
037- AO 
037-50 
C  3  7C  6  0 
0 2  7°  7C 
0  37-60 
3  3  79  -0 


Q  **  .10  0 

C  3  ■  3 1 : 
C  !  '2D 
*  2 .  ■)  3  " 
r  t  r 


rj 


A-ll 


•.  %  s' •> 


*.V.’ . 


/  * 


**  Appendix  A-6  ## 


d  R  R  ' U T  ;  \  E  D •  «*P“  P  (  J  t  >  !  \  »  A  T  ” 1  It)) 

CHA8  AC'ER*  K  AT',;:BtDU*-*'Y(5C)*l 

pr :  \ "  * « •  • 

PP  T*  ,  »THE  IPIKE  P  ;  C  B  AP I  c  I  T  I  £  S  RESULT  I'.  "HE  • 

P°;  ,  T*»*FJLLCUIf.G  PLC*:« 

pr  :*;*•»  *  • 

pp  0.0  C  •  2  0.“  0.6 

pr  r« "  *♦  *  ♦ - ♦ - - - 

DEL"  A=AB5(ATT (J«2 )  —  A  "  7  (J*  2 ) ) / 1C  < 

X=  AM  IM  <  AT  T(J,2)  *AT*  <J»3  )> 

INDE  v  =  m:  N  - 1 

oc  i :  i  =  3*5 
X= *♦ DEL*  A 
DC  1  K=l»53 
DU  PM  Y  <  K  )  =  •  • 

TMH  X  =  I  «0EX*  1 

rST0P=I‘<T(  ATT{  J,:n0EX»/.’2  > 

dc  2 c  i:=i*:s"cp 

DU  MM  Y  (  :  I  )  =  •  *  • 

CCNiT  IfiUE 

WRITE(**  •«  lv  ♦  F1C.4,5''A1  »  MX«<0UM"VC2  >*II=1»5C> 

ccnt:  vje 

PR  I*;*  ♦ - - - - - ♦— 

PR  C  .  *  ■'•2  0.*  C.t 

p«  I  i  •  •  •  •  • 

pr:'iT«,»:pike  p* .babili-ies  for  attribute  •♦attrib 

P-  :  t  7*  ♦  •  (  Y-AXI  C  I  Z  A  T  T  c  I  rtU  7E  LEVEL)* 


; p I k e  p; cbap: ciT : £s  result 


0.8  • 


p- : ,  t*  ,  •  (  y-a  x:  s 

pr  :  v  * , »  * 

cEtjR,j 
E’«  0 


A-12 


03  05C 

os  oe: 

0  28  970 
03R0?C 
03P0  C 
0  3 ’ ICO 
03  110 
0  3  R  1  2  0 
03  130 
03*140 
03-150 
03  160 
0361  70 
0  38 1 8  C 
0  36 1°  0 
03*  2CC 
C  3  ~  2 1 0 
036220 
03*230 
03P240 
03^250 
038260 
03827C 
03F290 
0  3  0  2  8  0 
03  30 C 
C  3r 31 C 
0  3C  22 C 
03- 33C 
03  34C 


Appendix  B 

R  and  0  Funds  Allocation  Example 


WHAT  IS  YQUR  NANE,  PLEASE?  aaron  d. 

THANK  YOU,  AARON  D.  .  WE  WILL  NOW  BEGIN  THE 
DECISION  ANALYSIS. 

OPENING  FILE  NUNBER  1 

IS  THIS  DATA  NEW  <N>  OR  STORED  <S> ?n 


AARON  D.  , YOUR  OPTIONS  ARE* 

ATT  COP  DIS  DON  NOD  NEW  NUN  PRU  REV  SEL 
SEN  SPA  STA  SYS  TTL  WVC 

♦♦♦NOTE*  IF  YOU  NErD  AN  EXPLANATION,  AARON  D. 

TYPE  “HELP"  ♦♦♦ 

WHAT  IS  YOUR  CHOICE,  AARON  D.  ?ne» 

THE  FOLLOWING  INFOPNATION  WILL  ALLOW  YOU  TO  CHOOSE 
AN  EXISTING  <STORED>  DATA  FILE,  OR  TO  CONSTRUCT  A 
NEW  ONE,  AARON  D.  . 

THE  CURRENT  TREE  IS  NUNBER  1 

WITH  WHICH  TREE  WOULD  YOU  LIKE  TO  WORK,  AARON  D.  ?1 

OPENING  FILE  NUNBER  I 

IS  THIS  DATA  NEW  <N>  OR  STORED  <S> ?n 

FILE  1  HAS  NO  CURRENT  TREE  STRUCTURE.  YOU  ARE 
BEING  TRANSFERRED  TO  OPTION  ♦«♦  NEW  ♦♦♦. 


YOU  APE  AT  THE  POINT  WHERE  YOU  WILL  BE  ENTERING 
THE  ALTERNATIVE  SYSTENS  WHICH  WILL  BE  RANKED 
IN  TERNS  OF  PREFERENCE.  PLEASE  CHOOSE  THE 
APPROPRIATE  OPTION. 

ACDD  DvELETE  N  •  EW  ECXIT 
?n 


B-l 


‘ji  »  _ 


ENTER... SYSTEM  1  LABEL 
<10  LETTERS  DR  LESS) 
?proJect  s 

ENTER. . . SYSTEM  2  LABEL 
<10  LETTERS  OR  LESS) 
?proJect  t 

ENTER... SYSTEM  3  LABEL 
<10  LETTERS  DR  LESS) 
?proJect  x 

ENTER... SYSTEM  4  LABEL 
<10  LETTERS  DR  LESS) 
?pr oJect  y 

ENTER. . .SYSTEM  5  LABEL 
<10  LETTERS  DR  LESS) 
?proJect  2 

ENTER.. .SYSTEM  6  LABEL 
<10  LETTERS  DR  LESS) 

-7 


YOU  ARE  AT  THE  POINT  WHERE  YOU  WILL  BE  ENTERING 
THE  ALTERNATIVE  SYSTEMS  WHICH  WILL  BE  RANKED 
IN  TERMS  DF  PREFERENCE.  PLEASE  CHDDSE  THE 
APPROPRIATE  DPTIDN. 

A  <DD  D  <ELETE  N  <EW  ECXIT 
?e 


ENTER  A  TITLE  FDR  THIS  DATA  STRUCTURE... 
?  research  and  development 
?  funds  allocation  - 
?  project  selection 


.  ^  vs  s  vv 


1 


SPANNING  NODES* 
?a 


"A“=ftLL 


'SELECT 


DO  YOU  WISH  TO  BUILD  ft  MEW  TREE* 


ftftPOM  D. 


(Y'N) 


DO  YOU  WISH  TO  BY-PftSS  THE  BETWEEN  MODE  CHECKTn 
ADDINS  DOWNLINKS  TO  MODE* 

0 

ftftPOM  D.  *  WHftT  IS  THE  NEXT  SUB01JECTI VE? 

(USE  MO  MORE  THftN  TWO  80  CHftRftCTER  LIMES> 

?  to  provide  for  aucoeesfeiul 

PLEASE  COMTIMUE 

?  r  and  d  efforts 

THE  LftST  SUBOBJECTIVE  ENTERED  IS* 

TO  PROVIDE  FOR  SUCCESSFUL 

R  ftMD  D  EFFORTS 


CURRENT  NUMBER  OF  MODES*  2 (MftX  300) 
CURRENT  NUMBER  OF  LEVELS*  2 (MftX  20) 
CURRENT  NUMBER  OF  SYSTEMS*  5 (MftX  59) 
ADDINS  DOWNLINKS  TO  NODE* 

1 

TO  PROVIDE  FOR  SUCCESSFUL 
R  AND  D  EFFORTS 


AARON  D.  »  WHftT  IS  THE  NEXT  SUBOBJECTIVE? 
(USE  NO  MORE  THftN  TWO  80  CHARACTER  LINES) 

?  to  produce  significant  results 
PLEASE  CONTINUE 
?  from  r  and  d  efforts 
THE  LAST  SUBOBJECTIVE  ENTERED  IS* 

TO  PRODUCE  SIGNIFICANT  RESULTS 


FROM  R  AND  D  EFFORTS 


'  .  •  v *  •  *  V 
-f ■ 


*  •  “  .  *  •  • 


WHICH  IS  SUBDBJECTIVE  HUMBER  1 
FOR  THE  OBJECTIVE: 

TO  PROVIDE  FOR  SUCCESSFUL 

R  PHD  D  EFFORTS 


CURREHT  HUMBER  OF  MODES*  3  <MAX  500) 
CURRENT  HUMBER  OF  LEVELS*  2<MAX  20) 
CURREHT  HUMBER  OF  SYSTEMS*  5  (MAX  59) 
ADDING  DOWMLIHKS  TO  MODE* 

1  1 

TO  PRODUCE  SIGNIFICANT  RESULTS 
FROM  R  PHD  D  EFFORTS 


PPRON  D.  *  WHAT  IS  THE  NEXT  SUBDBJECTIVE? 
<USE  NO  MORE  THAN  TWO  80  CHARACTER  LINES) 

?  to  expand  technolos*  base*  but  not  at 
PLEASE  CONTINUE 

?  expense  of  focused  r  add  d  efforts 
THE  LAST  SUBOBJECTIVE  ENTERED  IS* 

TO  EXPAND  TECHNOLOGY  BASE*  BUT  HOT  AT 

EXPENSE  OF  FOCUSED  R  AMD  D  EFFORTS 


WHICH  IS  SUBOBJECTIVE  HUMBER  l 
FOR  THE  OBJECTIVE: 

TO  PRODUCE  SIGNIFICANT  RESULTS 

FROM  R  AHD  D  EFFORTS 


AARON  D.  »  WHAT  IS  THE  NEXT  SUBOBJECTIVE? 
<USE  NO  MORE  THAN  TWO  80  CHARACTER  LINES) 

?  to  sain  sponsorship  for  fundina  the 
PLEASE  CONTINUE 

?  advanced  development  of  r  and  d  projects 
THE  LAST  SUBOBJECTIVE  ENTERED  IS: 

TO  GAIN  SPONSORSHIP  FOP  FUNDING  THE 

ADVANCED  DEVELOPMENT  OF  R  AND  D  PROJECT 


WHICH  IS  SUBOBJECTIVE  NUMBER  2 
FOP  THE  OBJECTIVE: 

TO  PRODUCE  SIGNIFICANT  RESULTS 


FROM  P  AND  D  EFFORTS 


•9  <9  <9 


AARON  D.  *  WHAT  IS  THE  NEXT  SUBOBJECTIVE? 
<USE  MO  MORE  THAN  TWO  80  CHARACTER  LIMES) 

?  to  dcaliz*  significant 
PLEASE  COMTIMUE 
?  results  in  minimum  timm 
THE  LAST  SUBOBJECTIVE  ENTERED  IS* 

TO  REALIZE  SIGNIFICANT 

RESULTS  IM  MINIMUM  TIME 


WHICH  IS  SUBOBJECTIVE  NUMBER  3 
FOR  THE  OBJECTIVE* 

TO  PRODUCE  SIGNIFICANT  RESULTS 


FROM  R  AND  D  EFFORTS 


AARON  D.  >  WHAT  IS  THE  NEXT  SUBDBJECTIVE? 
(USE  NO  MORE  THAN  TWO  80  CHARACTER  LINES) 


TO  PRODUCE  SIGNIFICANT  RESULTS 
FROM  R  AND  D  EFFORTS 


9  i?  TO  EXPAND  TECHNOLOGY  BASE?  BUT  NOT  AT  9 

I»  ia  i» 

iaiaeiat»eeeee  expense  of  focused  r  and  d  efforts  9 


?  I?  TO  GAIN  SPONSORSHIP  FOR  FUNDING  THE  9 

)  i?  i? 

ADVANCED  DEVELOPMENT  OF  R  AND  D  PROJECT# 

?  '?S  i? 


3 


i?  i?  TO  REALIZE  SIGNIFICANT 

i?  i? 

RESULTS  IN  MINIMUM  TIME 


AARON  D.  *  DD  THE  SUBOBJECTIVES  REDRESS  RLL  FRCETS 
OF  THE  PARENT  OBJECTIVE?  <Y/N> 

?y 

IS  THERE  ANY  OVERLAP  BETWEEN  THE  COVERAGES  OF 
THE  SUBOBJECT IVES »  AARON  D.  ?  <Y/N> 


AARON  D.  *  ARE  ALL  THE  SUBOBJECTIVES  OPERATIONALLY 
HEANIN6FUL  TO  YOU?  <Y^N) 

?y 

COULD  ANY  OF  THE  SUBOBJECTIVES  BE  IGNORED  WITHOUT 
SIGNIFICANTLY  INPACTING  YOUR  PREFERENCES*  AARON  D.  ?  <Y/N> 
?n 


CURRENT  NUNBER  OF  NODES:  6  <NAX  500> 
CURRENT  NUNBER  OF  LEVELS:  3 (MAX  20) 
CURRENT  NUNBER  OF  SYSTENS:  5<NAX  59) 
ADDING  DOWNLINKS  TO  NODE: 

1  1  1 

TO  EXPAND  TECHNOLOGY  BASE*  BUT  NOT  AT 
EXPENSE  OF  FOCUSED  R  AND  D  EFFORTS 


AARON  D.  »  WHAT  IS  THE  NEXT  SUBOBJECTIVE? 
(USE  NO  NORE  THAN  TWO  80  CHARACTER  LINES) 

7  to  start  projects  with  hi  ah  probability 
PLEASE  CONTINUE 

?  of  success  in  meet  ins  identified  needs 
THE  LAST  SUBOBJECTIVE  ENTERED  IS: 

TO  START  PROJECTS  WITH  HIGH  PROBABILITY 

OF  SUCCESS  IN  NEETING  IDENTIFIED  NEEDS 


WHICH  IS  SUBOBJECTIVE  NUNBER  1 
FOR  THE  OBJECTIVE: 

TO  EXPAND  TECHNOLOGY  BASE*  BUT  NDT  AT 


EXPENSE  OF  FOCUSED  R  AND  D  EFFORT! 


CURRENT  NUMBER  OF  NODES*  9 (MAX  300) 
CURRENT  NUMBER  OF  LEVELS*  4  (MAX  20) 
CURRENT  NUMBER  OF  SYSTEMS*  3  (MAX  39) 
ADDING  DOWNLINKS  TO  NODE* 

1  1  2 

TO  GRIN  SPONSORSHIP  FOR  FUNDING  THE 
ADVANCED  DEVELOPMENT  OF  R  AND  D  PROJECT 


AARON  D.  >  WHAT  IS  THE  NEXT  SUBOBJECTIVE? 
(USE  NO  MORE  THAN  TWO  80  CHARACTER  LINES) 

7  to  start  projects  with  the  sponsorship 
PLEASE  CONTINUE 

? comm it  development  funds  to  successful  i 
THE  LAST  SUBOBJECTIVE  ENTERED  IS* 

TO  START  PROJECTS  WITH  THE  SPONSORSHIP 
OF  MAJOR  ORGANIZATIONS  WILLING  TO 
COMMIT  DEVELOPMENT  FUNDS  TO  SUCCESSFUL 
P  AND  D  PROJECTS  (NUMBER  OF  SPONSORS) 


of  major  or aanizat ions  will  ins  to 
r  and  d  projects  (number  of  sponsors) 


WHICH  IS  SUBOBJECTIVE  NUMBER  l 
FOR  THE  OBJECTIVE* 

TO  GAIN  SPONSORSHIP  FOR  FUNDING  THE 

ADVANCED  DEVELOPMENT  OF  R  AND  D  PROJECT 


AARON  D.  *  WHAT  IS  THE  NEXT  SUBOBJECTIVE? 
(USE  NO  MORE  THAN  TWO  80  CHARACTER  LINES) 


CURRENT  NUMBER  OF  NODES*  *1  (MAX  300) 
CURRENT  NUMBER  OF  LEVELS:  4 (MAX  20) 
CURRENT  NUMBER  OF  SYSTEMS*  3 (MAX  39) 
ADDING  DOWNLINKS  TO  NODE* 

112  1 

TO  START  PROJECTS  WITH  THE  SPONSORSHIP 
OF  MAJOR  ORGANIZATIONS  WILLING  TO 
COMMIT  DEVELOPMENT  FUNDS  TO  SUCCESSFUL 
P  AND  D  PROJECTS  (NUMBER  OF  SPONSORS) 


ADDING  DOWNLINKS  TO  NODE: 
1  1  3 

TO  REALIZE  SIGNIFICANT 
RESULTS  IN  MINIMUM  TIME 


AARON  D.  »  WHAT  IS  THE  NEXT  SUBOBJECTIVE? 
<USE  NO  MORE  THAN  TWO  80  CHARACTER  LINES) 

?  to  start  r  and  d  projects  with 

PLEASE  CONTINUE 

{?  minimum  time  to  fruition 

THE  LAST  SUBOBJECTIVE  ENTERED  IS: 

TO  START  R  AND  D  PROJECTS  WITH 

MINIMUM  TIME  TO  FRUITION 


WHICH  IS  SUBOBJECTIVE  NUMBER  I 
fOR  THE  OBJECTIVE: 

TO  REALIZE  SIGNIFICANT 

RESULTS  IN  MINIMUM  TIME 


AARON  D.  ,  PLEASE  INPUT  AN  ATTRIBUTE  FDR 
THE  DATA  NODE  WITH  THE  OBJECTIVE: 

TO  START  R  AND  D  PROJECTS  WITH  AN 
ESTABLISHED  TECHNOLOGY  BASE  WITH  WHICH 
TO  MEET  IDENTIFIED  NEEDS 
•(TECHNOLOGY  BASE  UNITS  -  TB  UNITS) 

(10  LETTERS  OR  LESS) 

?  tb  units 

IS  THE  ATTRIBUTE  TB  UNITS 
SUCH  THAT  BY  KNOWING  ITS  LEVEL? 

THE  ATTAINMENT  OP  THE  OBJECTIVE 
IS  TOTALLY  DETERMINED?  <Y'N> 


COULD  THE  ATTRIBUTE  TB  UNITS 
BE  CHANGED  SO  AS  TO  IMPROVE 
COMMUNICATING  WHAT  IS  IMPLIED 
IN  THE  OBJECTIVE?  <Y.'N> 

?n 


WILL  THIS  ATTRIBUTE  BE  PROBABILISTIC  ?  >Y 


WHAT  IS  THE  WORST  ACCEPTABLE 
LEVEL  <REAL  NUMBER)  OF  TB  UNITS 

?0 

THE  LEVEL  STORED  WAS  0. 

WHAT  IS  THE  BEST  -'REALISTICALLY) 

LEVEL  (REAL  NUMBER)  OF  TB  UNITS  »  AARON  D. 

?10 

THE  LEVEL  STORED  WAS  10. 

AARON  D.  >  PLEASE  INPUT  AN  ATTRIBUTE  FOR 
THE  DATA  NODE  WITH  THE  OBJECTIVE* 

TO  START  PROJECTS  WITH  THE  SPONSORSHIP 
OF  MAJOR  ORGANIZATIONS  WILLING  TO 
COMMIT  DEVELOPMENT  FUNDS  TO  SUCCESSPJL 
R  AND  D  PROJECTS  (NUMBER  OF  SPONSORS) 

(10  LETTERS  OR  LESS) 

’sponsors 

IS  THE  ATTRIBUTE  SPONSORS 
SUCH  THAT  BY  KNOWING  ITS  LEVEL > 

THE  ATTAINMENT  OF  THE  OBJECTIVE 
IS  TOTALLY  DETERMINED?  (Y'N) 

?v 

COULD  THE  ATTRIBUTE  SPONSORS ' 

BE  CHANGED  SO  AS  TO  IMPROVE  . 

COMMUNICATING  WHAT  IS  IMPLIED 
IN  THE  OBJECTIVE?  (Y^N) 

?n 

WILL  THIS  ATTRIBUTE  BE  PROBABILISTIC  ?  (Y/N) 
?■* 

WHAT  IS  THE  WORST  ACCEPTABLE 
LEVEL  (REAL  NUMBER)  OF  SPONSORS 

?0 

THE  LEVEL  STORED  WAS  0. 

WHAT  IS  THE  BEST  (REALISTICALLY) 

LEVEL  (REAL  NUMBER)  OF  SPONSORS  *  AARON  D. 

?10 

THE  LEVEL  STORED  WAS  10. 

AARON  D.  >  PLEASE  INPUT  AN  ATTRIBUTE  FOR 
THE  DATA  NODE  WITH  THE  OBJECTIVE* 

TO  START  R  AND  D  PROJECTS  WITH 

MINIMUM  TIME  TO  FRUITION 


(10  LETTERS  OR  LESS) 


IS  the  ATTRIBUTE  TIME*  YEARS 
SUCH  THAT  BY  KNOWING  ITS  LEVEL  » 

THE  ATTAINMENT  OF  THE  OBJECTIVE 
IS  TOTALLY  DETERMINED?  (Y^N) 

'7'-i 

COULD  THE  ATTRIBUTE  TIME* YEARS 
BE  CHANGED  SO  AS  TO  IMPROVE 
COMMUNICATING  WHAT  IS  IMPLIED 
IN  THE  OBJECTIVE?  (Y^N) 

?n 

WILL  THIS  ATTRIBUTE  BE  PROBABILISTIC  ?  (Y^N) 

?s* 

WHAT  IS  THE  WORST  ACCEPTABLE 
LEVEL  (RE  NUMBER)  OF  TIME. YEARS 

?5 

THE  LEVEL  STORED  WAS  5. 

WHAT  IS  THE  BEST  (REALISTICALLY) 

LEVEL  (PEAL  NUMBER)  OF  TIME. YEARS*  AARON  D.  ? 

?0 

THE  LEVEL  STORED  WAS  0. 

TB  UNITS  SPONSORS  TIME. YEARS 

THE  ABOVE  IS  THE  CURRENT  SET  OF  ATTRIBUTES.  AARDN  D. 
IF  YOU  SEE  ANY  WHICH  ARE  REDUNDANT.  OR 
WHICH  HAVE  A  DIRECT  IMPACT  ON  ONE  ANOTHER 
(E.G.  WEIGHT  AND  THRUST) » 

YOU  SHOULD  REFORM  THE  ATTRIBUTE  SET  TO 
REMOVE  THESE  PROBLEMS. 

DO  YOU  WISH  TO  REFORM  THE  ATTRIBUTE  SET.  AARDN  D.  ? 

<  Y.-'N)  ?n 


DO  YOU  WISH  TO  BYPASS  INDEPENDENCE  TESTING?!-. 

AT  WHAT  TOLERANCE  DO  YOU  WANT  TD  CHECK  YOUR 
RESPONSEAARON  D.  (PLUS  OP  MINUS  X  PERCENT) ? 

X=?l  ft 

■JE  ARE  WORKING  AT  PLUS  OR  MINUS  10  PERCENT 

AARON  D.  WHICH  ATTRIBUTE  DO  YDU  WISH  TO  EXPLORE  THE 

UTILITY  INDEPENDENCE  OF 

UTILITY  INDEPENDENCE  OF?  (IF  YOU  WISH  TO  REVIEW 
THE  ATTRIBUTES  IN  THE  ORDER  THEY  WERE  INPUT* 

ENTER  1000.  OTHERWISE  ENTER  THE  ATTRIBUTE  NUMBER  NOW.) 
1  0  0  0 

ATTRIBUTE  NUMBER 
TE  UNITS  1 
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SPONSORS  2 
TINE, YEARS  3 

PAPON  D.  WHICH-  ATTRIBUTE  DO  YOU  WISH  TO  EXPLORE  THE 
.UTILITY  INDEPENB 

UTILITY  INDEPENDENCE  OF?  <IF  YOU  WISH  TO  REVIEW 
THE  ATTRIBUTES  IN  THE  ORDER  THEY  WERE  INPUT, 

ENTER  1000,  OTHERWISE  ENTER  THE  ATTRIBUTE  NUHBER  NOW.) I 


(SUPPOSE  THAT  THE  FOLLOWING 
•ATTRIBUTES  ARE  AT  THESE  LEVELS: 
TIME, YEARS  *  1.23 
•THAT  IS  AT  THE  23  PERCENT  LEVEL 


I  NOW  SUPPOSE  THAT  YOU  HAVE  THE  INITIAL  CONDITIONS: 
j TB  UNITS  »3.  AND  SPONSORS  »5. 

IMAGINE  THAT  SPONSORS  IS  CHANGED  TO  2. 

:  WHAT  LEVEL  OF  TB  UNITS  WOULD  KEEP  YOU  AS  SATISFIED 
AS  YOU  WERE  UNDER  THE  INITIAL  CONDITIONS? 

•  < REMEMBER  THAT  ALL  OTHER  ATTRIBUTES  ARE  AT 
i  THE  23  PERCENT  LEVEL) 

?3 

i  SUPPOSE  THAT  YOU  ARE  STARTING  AC 
TB  UNITS  *3.  AND  SPONSORS  *3. 

1  IMAGINE  T 

IMAGINE  THAT  8.  IN  SPONSORS  IS  ACHIEVED. 

TO  WHAT  LEVEL  WOULD  YOU  CHAN 

TO  WHAT  LEVEL  WOULD  YOU  CHANGE  TB  UNITS  IN  ORDER  TO 
REMAIN  AS  SATISFIED  AS  YOU  WERE  INITIALLY? 


'/REMEMBER  THAT  ALL  OTHER  ATTRIBUTES  ARE  AT  THE 
23  PERCENT  LEVEL) 

?3 


AARON  D.  ,  SUPPOSE  NOW  THAT  THE  FOLLOWING  ATTRIBUTES 
APE  SHIFTED 

ARE  SHIFTED  TO  THESE  LEVELS: 

TIME, YEARS* 3. 73 

THAT  IS  AT  THE  73  PERCENT  LEVEL 


SUPPOSE  THAT  YOU  HR/E 

T3  UNITS  *3.  AND  SPONSORS  =3. 


IMAGINE  THAT  THE  LEVEL  OF  SPONSOR': 

IS  CHANGED  TO  2. . 

MOULD  THE  LEVEL  OF  TB  UNITS  NEEDED  TO  RE MR IN 
AS  SRTISFIED  RS  RT  THE  INITIAL  CONDITIONS:  . 

LIE  BETWEEN  8.5  AND  7.5  ...... 

.  <Y/N>  ?v 

I 

SUPPOSE  THAT  YOU  HAVE  THE  INITAL  CONDITIONS: 

[TB  UNITS  =5.  AND  SPONSORS  *5.  - 

IlflASINE  THAT  YOU  MUST  ACCEPT 


In  LEVEL  OF  8.  IN  SPONSORS 

MOULD  THE  LEVEL  OF  TB  UNITS  -  - 

THAT  YOU  WOULD  HAVE  TO  MOVE  TO  <IN  ORDER  TO  BE  A: 
SATISFIED  AS  UNDER  THE  . INITAL  CONDITIONS^  LIE -  -  - 
BETWEEN  3.5  AND  2.5  -  -  *  1, 

<Y/N>  ?s 

THERE  ARE  NO  INDEPENDENCE  PROBLEMS 
WITH  THE  ATTRIBUTES  TESTED  SO  FAR, 

DO  YOU  WISH  TO  ASSUME  HP  I  FOR  THE 
REMAINING  ATTRIBUTES?  <Y^N)  --  -  - 

?n 

EVEN  IF  YOU  DO  NOT  WISH  TO  ASSUME 
ftp  I  AMOUNG  THE  ATTRIBUTES. 

[do  you  want  to  stop  miji  testing-  <y/n:>. 

I  ?n 


SUPPOSE  THAT  THE  FOLLOWING 
ATTRIBUTES  ARE  AT  THESE  LEVELS: 

SPONSORS  =2.5 

THAT  IS  AT  THE  25  PERCENT  LEVEL 

NOW  SUPPOSE  THAT  YOU  HAVE  THE  INITIAL  CONDITIONS: 
TB  UNITS  =5.  AND  TIME, YEARS-2 . 5 


IMAGINE  THAT  TIME,  YEAR'S  IS  CHANGED  TO  1. 

MHAT  LEVEL  OF  TB  UNITS  WOULD  KEEP  YOU  AS  SATISFIED 
lAS  YOU  WERE  UNDER  THE  INITIAL  CONDITIONS'? 

•REMEMBER  THAT  ALL  OTHER  ATTRIBUTES  ARE  AT 
THE  25  PERCENT  LEVEL > 


SUPPOSE  THAT  YOU  APE  STARTING  AT 
(TB  UNITS  =5.  AND  TIME ,  YEARS  =2.  5 


IMAGINE  THAT  4.  IN  TIME* YEARS  IS  ACHIEVED. 

TS  ■••HAT  LEVEL  WOULD  YOU  CHANGE  TB  UNITS  IN  ORDER  TD 
REMAIN  AS  SATISFIED  AS  YOU  WERE  INITIALLY? 

•'REMEMBER  THAT  ALL  OTHER  ATTRIBUTES  ARE  AT  THE 
25  PERCENT  LEVEL > 


AARON  D.  *  SUPPOSE  NOW  THAT  THE  FOLLOWING  ATTRIBUTE: 
ARE  SHIFTED  TO  THESE  LEVELS: 

SPONSORS  =7.5 

THAT  IS  AT  THE  75  PERCENT  LEVEL 

SUPPOSE  THAT  YOU  HAVE 

TB  UNITS  =5.  AND  TIME. YEARS=2. 5 

IMAGINE  THAT  THE  LEVEL  OF  TINE* YEARS 
IS  CHANGED  TO  I.. 

WOULD  THE  LEVEL  OF  TB  UNITS  NEEDED  TO  REMAIN 
AS  SATISFIED  AS  AT  THE  INITIAL  CONDITIONS 
LIE  BETWEEN  2.5  AND  1.5 

CY-N)  ?s 

SUPPOSE  THAT  YOU  HAVE  THE  INITAL  CONDITIONS: 

TB  UNITS  =5.  AND  TIME. YEARS=2 . 5 

IMAGINE  THAT  YOU  MUST  ACCEPT 
A  LEVEL  OF  4.  IN  TIME. YEARS 
WOULD  THE  LEVEL  OF  TB  UNITS 

THAT  YOU  WOULD  HAVE  TO  MOVE  TO  <IN  ORDER  TO  BE  AS 
SATISFIED  AS  UNDER  THE  INITAL  CONDITIONS)  LIE 
BETWEEN  3.5  AND  7.5 

CY.'N) 

THERE  ARE  NO  INDEPENDENCE  PROBLEMS 
WITH  THE  ATTRIBUTES  TESTED  SO  FAR. 

DO  YOU  WISH  TO  ASSUME  MPI  FOR  THE 
REMAINING  ATTRIBUTES?  <Y/?0 
?n 

EVEN  IF  YOU  DO  NOT  WISH  TO  ASSUME 
MPI  AMOUNG  THE  ATTRIBUTES. 

DO  YOU  WANT  TO  STOP  MU  I  TEST IN 

DO  YOU  WANT  TO  STOP  MU I  TESTING?  <Y^N> . 

?n 

SINCE  TB  UNITS  IS  PAIRWISE  PREFERENTIALLY 
INDEPENDENT  OF  THE  OTHER  ATTRIBUTES.  ATTRIBUTE 
TB  UNITS  WILL  NOW  BE  TESTED  FOR  UTILITY  INDEPENDENCE 

WITH  THE  OTHER  ATTRIBUTES  EXCEPT  TB  UNITS 
SET  AS  THE  FOLLOWING  LEVELS 

SPONSORS  *  2.5 
TIME.  YEARS  =  1.25 

NOW  WHAT  VALUE  OF  ATTRIBUTE  TB  UNITS  WITH  CERTAINTY 
WOULD  YOU  TRADE  FOR  A  LOTTERY  OF  A  50-50  CHAN 

WOULD  YOU  TRADE  FOR  A  LOTTERY  OF  A  50-50  CHANCE  OF 
RECEIVING  EITHER  10.  UNITS  OR  0.  UNITS  OF 
ATTRIBUTE  TB  UNITS 


■  TV'- 


■7.  VS  \t  JW'.-. 


NOW  WHAT  VALUE  OF  ATTRIBUTE  TB  UNITS  WITH  CERTAINTY 
WOULD  YOU  TRADE  FOR  A  LOTTERY  OF  A  50-50  C 

WOULD  YOU  TRADE  FOR  A  LOTTERY  OF  A  50-50  CHANCE  OF 
RECEIVING  EITHER  10.  UNITS  OR  3.  UNITS  OF 
ATTRIBUTE  TB  UNITS 
?6 

NOW  WHAT  VALUE  OF  ATTRIBUTE  TB  UNITS  WITH  CERTAINTY 
WOULD  YOU  TRADE  FDR  A  LOTTERY  DF  A  50-50  CHANCE  OF 
RECEIVING  EITHER  3.  UNITS  OR  0.  UNITS  OF 
ATTRIBUTE  TB  UNITS 
?1._ 

AARON  D.  *  SUPPOSE  NOW  THAT  THE  FOLLOWING  ATTRIBUTES 
ARE  SHIFTED  TO  THESE  LEVELS: 

SPONSORS  *7.5 
TIME*  Y£ARS=3.  75 

THAT  IS  AT  THE  75  PERCENT  LEVEL 

NOW  FOR  THE  LOTTERY  OF  A  50-50  CHANCE  OF  RECEIVING  EITHER 

10.  UNITS  OP  0.  UNITS  DF  ATTRIBUTE  TB  UNITS 

WOULD  YOU  TRADE  FOR  A  VALUE  OF  ATTRIBUTE  TB  UNITS  WITH 

CERTAINTY  BETWEEN  3.5  UNITS  AND  2.5 

UNITS*  <Y/N>?st 

NOW  FOR  THE  LOTTERY  OF  A  50-50  CHANCE  OF  RECEIVING  EITHER 

10.  UNITS  OR  3.  UNITS  OF  ATTRIBUTE  TB  UNITS 

WOULD  YOU  TRADE  FOR  A  VALUE  OF  ATTRIBUTE  TB  UNITS  WITH 

CERTAINTY  BETWEEN  6.5  UNITS  AND  5.5 

UNITS.  <Y/N>v 

NOW  FOR  THE  LOTTERY  OF  A  50-50  CHANCE  OF  RECEIVING  EITHER 
3.  UNITS  OR  0.  UNITS  OF  ATTRIBUTE  TB  UNITS 
WITH  CERTAINTY  BETWEEN  1.5  UNITS  AND  .5 
UNITS.  OrVN)-* 

ONLY  MY“  OR  “N"  IS  ALLOWED*  AARON  D. 

NOW  FOR  THE  LOTTERY  OF  A  50-50  CHANCE  OF  RECEIVING  EITHER 
3.  UNITS  OR  0.  UNITS  OF  ATTRIBUTE  TB  UNITS 
WITH  CERTAINTY  BETWEEN  1.5  UNITS  AND  .5 
UNITS.  <Y'N>* 

ONLY  "Y"  OR  " N **  IS  ALLOWED*  AARON  D. 

NOW  FOP  THE  LOTTERY  OF  A  50-50  CHANCE  OF  RECEIVING  EITHER 
3.  UNITS  DR  0.  UNITS  OF  ATTRIBUTE  TB  UNITS 
WITH  CERTAINTY  BETWEEN  1.5  UNITS  AND  .5 
UNITS.  <Y/N>v 


THE  ATTRIBUTES  ARE  UTILITY  INDEPENDENT 


THE  UTILITY  FUNCTIONS  FOP  EACH  ATTRIBUTE 
WILL  NOW  BE  DETERMINED 
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THE  UTILITY  FUNCTIONS  FOR  EACH  ATTRIBUTE 
WILL  NOW  BE  DETERMINED 


NOW  WHAT  LEVEL  OF  ATTRIBUTE  TB  UNITS 
WITH  CERTAINTY  WOULD  YOU  TRADE  FOR  A  LOTTERY 
WITH  A  30-30  CHANCE  OF  RECEIVING  EITHER 
10.  UNITS  OR  0.  UNITS  OF  ATTRIBUTE  TB  UNITS 

?3 

NOW  WHAT  LEVEL  OF  ATTRIBUTE  TB  UNITS 
WITH  CERTAINTY  WOULD  YOU  TRADE  FOR  A  LOTTERY 
WITH  A  50-30  CHANCE  OF  RECEIVING  EITHER 
3.  UNITS  OR  0.  UNITS  OF  ATTRIBUTE  TB  UNITS 
?1 . 5 

NOW  WHAT  LEVEL  OF  ATTRIBUTE  TB  UNITS 
WITH  CERTAINTY  WOULD  YOU  TRADE  FOR  A  LOTTERY 
WITH  A  30-50  CHANCE  OF  RECEIVING  EITHER 
3.  UNITS  OR  10.  UNITS  OF  ATTRIBUTE  TB  UNITS 

?6 


THE  ABOVE  YIELDS  A  UTILITY  FUNCTION  FOR 
WITH  PARAMETERS* 

B0*. 0360853789916  Bl*. 4143262372913 
SUM  OF  SQUARED  ERROR*. 00439473958282 
<LOGAFITHMIC  FORM) 

UTIL I TY*B0+B1«LN< ATTRIBUTE  LEVEL) 


TB  UNITS 


0.0  .23 

UTILITY 


UTILITY  FUNCTION  FOR  TB  UNITS 


DOES  THE  ABOVE  REPRESENTATION  APPEAR  REASONABLE?  <Y'N> 
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NOW  WHAT  LEVEL  OF  ATTRIBUTE  SPONSORS 
WITH  CERTAINTY  WOULD  YOU  TRADE  FOR  A  LOTTERY 
WITH  A  30-50  CHANCE  OF  RECEIVIN6  EITHER 
10.  UNITS  OR  0.  UNITS  OF  ATTRIBUTE  SPONSORS 

?2 


NOW  WHAT  LEVEL  OF  ATTRIBUTE  SPONSORS 
WITH  CERTAINTY  WOULD  YOU  TRADE  FOR  A  LOTTERY 
WITH  A  50-50  CHANCE  OF  RECEIVING  EITHER 
2.  UNITS  OR  0.  UNITS  OF  ATTRIBUTE  SPONSORS 

NOW  WHAT  LEVEL  OF  ATTRIBUTE  SPONSORS 
WITH  CERTAINTY  WOULD  YOU  TRADE  FOR  A  LOTTERY 
WITH  A  50-50  CHANCE  OF  RECEIVING  EITHER 
2.  UNITS  OR  10.  UNITS  OF  ATTRIBUTE  SPONSORS 

?3 


THE  ABOVE  YIELDS  A  UTILITY  FUNCTION  FDR  SPONSORS 
WITH  PARAHETERS: 

B0*. 01501703492834  Bl*. 3317910697555 
SUN  OF  SQUARED  ERROR*. 03966886467344 
f SQU ARE-RDDT  FORN) 

UT I L I TY*B  0+B 1 ♦ < ATTR I BUTE  LEVEL>  ++0 . 5 


NOW  WHAT  LEVEL  OF  ATTRIBUTE  TIME* YEARS 
WITH  CERTAINTY  WOULD  YOU  TRADE  FDR  A  LOTTERY 
WITH  A  30-30  CHANCE  OF  RECEIVIN6  EITHER 
0.  UNITS  OR  3.  UNITS  OF  ATTRIBUTE  TIME»YEARS 
?4 

NOW  WHAT  LEVEL  OF  ATTRIBUTE  TIME* YEARS 
WITH  CERTAINTY  WOULD  YOU  TRADE  FOR  A  LOTTERY 
WITH  A  50-30  CHANCE  OF  RECEIVING  EITHER 
4.  UNITS  OR  3.  UNITS  OF  ATTRIBUTE  TIME* YEARS 
?4.5 

NOW  WHAT  LEVEL  OF  ATTRIBUTE  TIME* YEARS 
WITH  CERTAINTY  WOULD  YOU  TRADE  FOR  A  LOTTERY 
WITH  A  50-50  CHANCE  OF  RECEIVING  EITHER 
4.  UNITS  OR  0.  UNITS  OF  ATTRIBUTE  TIME* YEARS 

?3 

THE  ABOVE  YIELDS  A  UTILITY  FUNCTION  FOR  TIME* YEARS 
WITH  PARAMETERS* 

B 0=1 . 038734253292  Bl— .  0397673626542 

SUM  OF  SQUARED  ERROR*. 01603919683735 
(SQUARED  FORM> 

UT IL I  TY*B0-*-Bl*  (ATTRIBUTE  LEVEL>  ♦*€.  0 


0.  00 

-♦ 

* 

-*■ 

♦ 

♦ 

+• 

♦ 

1.00 

♦ 

♦ 

♦ 

♦ 

2.23 

— *■ 

♦ 

♦ 

♦ 

♦ 

♦ 

♦ 

♦ 

3.50 

-4- 

♦ 

♦ 

> 

♦ 

♦ 

♦ 

4.75 

-+• 

♦ 

A  .  -i- 

+  ■ 

0. 

0 

• 

f  ■■ 

25  .5 

.75  1 

UTILITY 

UTILITY  FUNCTION  FOR  TIME* YEARS 

DOES  THE  ABOVE  REPRESENTATION  APPEAR  REASONABLE?  (Y-'N) 
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YOU  MAY  HOW  ENTER  WEIGHTS*  VALUES*  OR  (RE) CALCULATE 
THE  TREE.  CHOOSE  YOUR  OPTIONS 

W <E I GHT  V  <flLUES  CALCULATE  E<XIT 

?v 

VALUES  s  A  <LL  S  (ELECT 

'?•» 

WE  ARE  AT  THE  DATA  NODE:  DATA  FOR 

TO  START  R  AND  D  PROJECTS  WITH  AH  PROJECT  S 

ESTABLISHED  TECHNOLOGY  BASE  WITH  WHr CH 
TO  MEET  IDENTIFIED  NEEDS 
(TECHNOLOGY  BASE  UNITS  -  TB  UNITS) 

WHICH  HAS  THE  ASSOCIATED  ATTRIBUTE  TB  UNITS 

THE  CURRENT  SPIKE  PROBABILITY  (SEE 
USER'S  MANUAL)  FOR  TB  UNITS 
AT  A  LEVEL  OF  1.  IS  0. 

WHAT  IS  THE  NEW  SPIKE  PROBABILITY 

?0 

THE  CURRENT  SPIKE  PROBABILITY  (SEE 
USER'S  MANUAL)  FOR  TB  UNITS 
AT  A  LEVEL  DF  2.  IS  0. 

WHAT  IS  THE  NEW  SPIKE  PROBABILITY 

?0 

THE  CURRENT  SPIKE  PROBABILITY  (SEE 
USER'S  MANUAL)  FOR  TB  UNITS 
AT  A  LEVEL  OF  3.  IS  0. 

WHAT  IS  THE  NEW  SPIKE  PROBABILITY 

«■>  "kC- 
!  •  fc-  -J 

THE  CURRENT  SPIKE  PROBABILITY  (SEE 
USER'S  MANUAL)  FOR  TE  UNITS 
AT  A  LEVEL  OF  4.  IS  0. 

WHAT  IS  THE  NEW  SPIKE  PROBABILITY 
?.  5 

THE  CURRENT  SPIKE  PROBABILITY  (SEE 
USER'S  MANUAL)  FOR  TB  UNITS 
AT  A  LEVEL  OF  5.  IS  0. 

WHAT  IS  THE  NEW  SPIKE  PROBABILITY 

?.  £5 
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THE  CURRENT  SPIKE  PROBABILITY  <SEE 
USER'S  MANUAL)  FOR  TB  UNITS 
AT  A  LEVEL  OF  6.  IS  0. 

WHAT  IS  THE  NEW  SPIKE  PROBABILITY 

TO 

THE  CURRENT  SPIKE  PROBABILITY  (SEE 
USER'S  MANUAL)  FOR  TB  UNITS 
AT  A  LEVEL  OF  7.  IS  0. 

WHAT  IS  THE  NEW  SPIKE  PROBABILITY 
?0 

THE  CURRENT  SPIKE  PROBABILITY  (SEE 
USER'S  MANUAL)  FOR  TB  UNITS 
AT  A  LEVEL  OF  8.  IS  0. 

WHAT  IS  THE  NEW  SPIKE  PROBABILITY 

TO 

THE  CURRENT  SPIKE  PROBABILITY  (SEE 
USER'S  MANUAL)  FOR  TB  UNITS 
AT  A  LEVEL  OF  9.  IS  0. 

WHAT  IS  THE  NEW  SPIKE  PROBABILITY 

TO 


THE  CURRENT  SPIKE  PROBABILITY  (SEE 
USER'S  MANUAL)  FOR  TB  UNITS 
AT  A  LEVEL  OF  10.  IS  0. 

WHAT  IS  THE  NEW  SPIKE  PROBABILITY 

TO 

THE  SPIKE  PROBABILITIES  RESULT  IN  THE 
FOLLOWING  PLOTS 


0.0  0.2  0.4  0.6  0.8 

+ - + - + - +• - +— 

1. 0000 
2. 0000 

3.  Q00Q*»»»»»«*»»»*» 


4. 0000 
3. 0000 
6. 0000 
7. 0000 
8.0000 
9. 0000 
10.0000 


0.  0  0.2  0.4 


0. 6 


0.3 


SPIKE  PROBABILITIES  FDR  ATTRIBUTE  TB  UNITS  PROJECT  S 

(Y-AXIS  IS  ATTRIBUTE  LEVEL) 
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v\ 


>  ■ 


1. 0000 
2.0000 
3. 0000 
4. 0000 
5.0000 
6.  0000»»»»» 
7.jOOOO***"*»*< 

a.  oooo»»»»»< 

■9.  0000 

10.-000'0*«*«*- 


♦  — . . — — - . 4 - 

0.0  .0.2  0.4 

- - -  -  4—  ... - 

0.6 

■  »  - 

0.8 

SPIKE  PROBABILITIES  FOR  ATTRIBUTE 

TB  UNITS 

PROJECT  T 

(Y-AXIS  IS  ATTRIBUTE  LEVEL) 

0.0  0.2  0.4 

- » — - - - ♦ - 

0.6 

— - +- ... - 

0.8 

- + - 

1.0000 
2.0000 
3. 0000 
4. 0000 
5. 0000 
6. 0000 
7. 0000 
3.0000 
9.0000 
10.  0000 


+ - ►— - 4— - 4- - - 

0.0  0^2  0.4  0.6 

SPIKE  PROBABILITIES  FOR  ATTRIBUTE  TB  UNITS 
(Y-AXIS  IS  ATTRIBUTE  LEVEL) 

0.8 

PROJECT  X 

0.  0  0.2  0.4  0.6 

4 - 4 - ►— - f - «. 

0.8 

- -4 - - 

1. 0000 
2. Ol/OO 
3. 0000 
4. 0000 
5. 0000 
6. 0000 
7. 0000 
8. 0000 
9. 0000 
10.  0000 


0.  0  0.2  0.4  0.6 


SPIKE  PROBABILITIES  FOP  ATTRIBUTE  TB  UNITS 
(Y-AXIS  IS  ATTRIBUTE  LEVEL) 


0.3 


PROJECT  Y 


1. 0000 
2. 0000 
3. 0000 
4. 0000 
5.0000 
6. 0000 
7.0000 
8. 0000* 
9. 0000« 
10.  0000 


SPIKE  PROBABILITIES  FOR  ATTRIBUTE  TB  UNITS 
CY-AXIS  IS  ATTRIBUTE  LEVEL} 


PROJECT  Z 


1.0000 
2. 0000 
3.0000 
4.0000 
5. 0000 
6. 0000 
7.  0000 
8.0000 
9.0000 
10.0000 


SPIKE  PROBABILITIES  FOR  ATTRIBUTE  SPONSORS 
< Y-AXIS  IS  ATTRIBUTE  LEVEL} 


PROJECT  S 


1. 0000-*^ 

2.  0000^ 

3.  OOOO^ 

4.  OOOO^ 

5.  0000^ 

6. 0000 

7. 0000 

a. oooo 

9. 0000 

10. 0000 


:PIKE  PROBABILITIES  FOR  ATTRIBUTE  SPONSORS 
(Y-AXIS  IS  ATTRIBUTE  LEVEL} 


0.3 


PROJECT  T 


0.2 


0.4 


0.6 


0.8 


1 . 0G00< 
2. 0000 
3. 0000 
4. 0000 
5.0000 
6.0000 
7. 0000 
8. 0000 
9. 0000 
10.  0000 


SPIKE  PROBABILITIES  FOR  ATTRIBUTE  SPONSORS 
< Y-AXIS  IS  ATTRIBUTE  LEVEL) 


1. 0000 
2.0000 
3. 0000 
4. 0000 
5. 0000 
6. 0000 
7.0000 
8. 0000 
9. 0000 
10. 0000 


PROJECT  X 


SPIKE  PROBABILITIES  FOR  ATTRIBUTE  SPONSORS 
< Y-AXIS  IS  ATTRIBUTE  LEVEL) 


PROJECT  Y 


1. 0000 

2.  0000< 

3.  0000< 

4.  0000< 
5. 0000 
6. 0000 
7. 0000 
8. 0000 
9. 0000 

10. 0000 


% 


SPIKE  PROBABILITIES  FOR  ATTRIBUTE  SPONSORS 
< Y-AXIS  IS  ATTRIBUTE  LEVEL) 
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PROJECT  Z 


K 


S  '  -  ’I*.'  • 


0.0 


0.2 


0.4 


0.6 


0.8 


.5000 
1.0000 
1 . 5000< 
2. 0000 < 
2.5000< 
3.0000< 

3.5000 
4.0000 

4.5000 
5.0000 


SPIKE  PROBABILITIES  FDR  ATTRIBUTE  TIME, YEARS 
< Y-AXIS  IS  ATTRIBUTE  LEVEL) 


PROJECT  S 


.5000 

1.0000 

1.5000 
2.  0000«** 
2.5000-** 
3.  OOOO^*- 
3.500Q*-* 
4. 0000 

4.5000 
5. 0000 


SPIKE  PROBABILITIES  FOR  ATTRIBUTE  TIME, YEARS 
< Y-AXIS  IS  ATTRIBUTE  LEVEL) 


PROJECT  T 


.5000 
1. 0000 

1.5000 

2. 0000 

2.5000 
3. 0000 

3.5000 
4.  0000 

4.5000 
5. 0000 


:P IKE  PROBABILITIES  FOR  ATTRIBUTE  TIME, YEARS 
Y-AXIS  IS  ATTRIBUTE  LEVEL) 


PROJECT  X 
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VA’.v.OY- 


1. 0000 

1.5000 
2. 0000 
2. 5000*-* 
3.  0000«"*« 
3.5000»*“* 
4. 0000*^« 
4.5000^ 
5.0000 


SPIKE  PROBABILITIES  FOR  ATTRIBUTE  TIRE » YEARS 
<Y— AXIS  IS  ATTRIBUTE  LEVEL> 


PROJECT  Y 


.5000 

1.0  000 

1.5000 

2. 0000 

2.5000 
3. 0000 

3.5000 
4. 0000 

4.5000 
5. 0000 


SPIKE  PROBABILITIES  FOR  ATTRIBUTE  TIRE* YEARS 
< Y-AXIS  IS  ATTRIBUTE  LEVEL) 


PROJECT  Z 


PROJECT  DATA  ENTERED 


YOU  MAY  MOW  EMTER  WEIGHTS*  VALUES*  OP  <PE> CALCULATE 
THE  TREE.  CHOOSE  YOUR  OPTION: 

W  <EIGHT  V  VALUES  C  CALCULATE  E  <X I  I 
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'  - - -  ' 


<  *  T  »  »  -  •*.  * 


-  •/  *.  'N.  V  *  V  * 


WE  ARE  WEIGHTING  THE  MODE  SET: 

TO  EXPAND  TECHNOLOGY  BASE*  BUT  MOT  AT 

EXPENSE  OF  FOCUSED  R  AND  D  EFFORTS 

THE  ABOVE  OBJECTIVE  IS  FACTOR  I 
TO  GAIN  SPONSORSHIP  FOR  FUNDING  THE 

ADVANCED  DEVELOPMENT  OF  R  AND  D  PROJECT 

THE  ABOVE  OBJECTIVE  IS  FACTOR  2 
TO  REALIZE  SIGNIFICANT 

RESULTS  IN  MINIMUM  TIME 

THE  ABOVE  OBJECTIVE  IS  FACTtW  3 

DO  YOU  WISH  TO  ENTER  THE  RELATIVE  WEIGHTS  DIRECTLY  * 

<Y/N)  ?* 

ENTER  THE  < UNNORMAL I ZED)  WEIGHTS. 

WHAT  IS  THE  WEIGHT  FOR  FACTOR  1 

?2 

WHAT  IS  THE  WEIGHT  FOR  FACTOR  2 

?5 

WHAT  IS  THE  WEIGHT  FOR  FACTOR  3 

?  3 

NORMAL I ZED : 2 0  50  30 

ARE  YOU  HAPPY  WITH  THESE  RELATIVE  WEIGHTS?  (Y^N) 

?•* 

ENTER  COMMENTS  ON  THESE  WEIGHTS 

?ok 


YOU  MAY  NOW  ENTER  WEIGHTS*  VALUES*  DR  <RE) CALCULATE 
THE  TREE.  CHOOSE  YOUR  OPTION: 

W  <E I GHT  V  <ALUES  C  'CALCULATE  -  XIT 


INTERIOR  TREE  VALUES  ARE  BEING  CALCULATED... 
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vS'Xv 


HOW  MUCH  DO  YOU  WANT  TO  REVIEW... 

A(LL  S  <ELECT 

?a 

IF  AMY  MODIFICATIONS  HAVE  BEEM  MADE  TO  THE  TREE 
SINCE  IT  HAS  BEEN  CALCULATED  > NUMERICAL  VALUES 
WILL  BE  INCORRECT. 

<PRESS  ANY  LETTER  TO  CONTINUE) 

?r 


REVIEW 

PESEAPCH  AND  DEVELOPMENT 
FUNDS  ALLOCATION  - 
PROJECT  SELECTION 

NODE  REFERENCE  NUMBER <AND  OBJECTIVE): 

1 

TO  PROVIDE  FOR  SUCCESSFUL 

R  AND  D  EFFORTS 

RELATIVE  WEI6HTJ  1. 

CUMULATIVE  WEIGHT:  1. 

SYSTEM  VALUES: 

PROJECT  S  PROJECT  T 

64. SO  64.68 

PROJECT  Z 

65.01 

Ok 

■'PRESS  ANY  LETTER  TO  CONTINUE  (EXCEPT  "E")) 
(PRESS  "E"  TO  EXIT) 


PROJECT  X  PROJECT  Y 

27.15  53.74 


Appendix  G 

Technology  Base  Units 


The  following  scale  was  used  to  note  projects  on  the 


attribute  reflecting  technical  foundation  of  a  research  area. 


Characteristic 


Technology  Base  (TB)  Scale 
0-10 


Research  Base  Fully  Developed 
Adequate  Data  To  Go  Into  Production 


Research  Base  Developing  With  Foundation 
For  Further  Development,  Growing  Data  Base 
For  Specific  Technology 


Research  3ase  Partially  Developed, 
Some  Data  Available  On  Specific 
Technology 


Research  Base  Undeveloped,  Data 
Available  But  Only  From  Related  Areas 


Research  Base  Undeveloped,  Technology 
Area  New,  No  Data 
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